-- Logs begin at Tue 2022-02-15 03:38:28 UTC, end at Tue 2022-02-15 04:45:11 UTC. -- Feb 15 04:11:06.240310 dv-cinder-816104-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 15 04:11:06.251196 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 04:11:06 2022] *** Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: nodename: dv-cinder-816104-2-iscsi Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: machine: x86_64 Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: clock source: unix Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: pcre jit disabled Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: detected number of CPU cores: 4 Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: current working directory: / Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: detected binary path: /usr/bin/uwsgi-core Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: your processes number limit is 47680 Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: your memory page size is 4096 bytes Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: detected max file descriptor number: 2048 Feb 15 04:11:06.252561 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: lock engine: pthread robust mutexes Feb 15 04:11:06.253530 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: thunder lock: enabled Feb 15 04:11:06.253530 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 15 04:11:06.253530 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 04:11:06.298048 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: Python main interpreter initialized at 0x55c62184c9c0 Feb 15 04:11:06.298048 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: python threads support enabled Feb 15 04:11:06.298048 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: your server socket listen backlog is limited to 100 connections Feb 15 04:11:06.298048 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: your mercy for graceful operations on workers is 90 seconds Feb 15 04:11:06.298478 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 04:11:06.298478 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: *** Operational MODE: preforking *** Feb 15 04:11:06.298712 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: *** uWSGI is running in multiple interpreter mode *** Feb 15 04:11:06.298712 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: spawned uWSGI master process (pid: 101894) Feb 15 04:11:06.298923 dv-cinder-816104-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 15 04:11:06.300026 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: spawned uWSGI worker 1 (pid: 101895, cores: 1) Feb 15 04:11:06.300026 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: spawned uWSGI worker 2 (pid: 101896, cores: 1) Feb 15 04:11:06.300026 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 04:11:08.130847 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:11:08.130847 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: from cryptography.utils import int_from_bytes Feb 15 04:11:08.131482 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:11:08.131482 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: from cryptography.utils import int_from_bytes Feb 15 04:11:08.177344 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:11:08.177344 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: from cryptography.utils import int_from_bytes Feb 15 04:11:08.177971 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:11:08.177971 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: from cryptography.utils import int_from_bytes Feb 15 04:11:10.762700 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 04:11:10.763306 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 04:11:10.763506 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 04:11:10.763834 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 04:11:10.764099 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 04:11:10.764493 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.764824 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.765197 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.765525 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.765863 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.765963 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 04:11:10.766313 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.766399 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 04:11:10.766494 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.766715 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 04:11:10.766808 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.767078 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 04:11:10.767172 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.767334 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 04:11:10.767426 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.767684 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.767774 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.768016 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816104-2-iscsi {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.768120 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.768341 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.768435 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.768658 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.768754 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769006 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769104 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769325 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769436 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769632 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769723 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.769949 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.770083 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.770260 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.770385 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.770515 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.770761 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.770912 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.771894 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816104-2-iscsi {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772033 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772154 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772289 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772418 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772547 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772684 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772806 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.772962 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773091 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773221 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773346 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773469 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773596 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773707 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773847 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.773847 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774088 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774230 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774359 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774359 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774577 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816104-2-iscsi {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774711 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774843 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.774966 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.775093 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.775491 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.775626 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.775848 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.775975 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.776226 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.776359 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.776541 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.776719 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.776851 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.776996 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.777200 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.777325 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.777516 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.777648 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816104-2-iscsi {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.777854 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.777990 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.778183 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.778316 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.778495 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.778620 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.778824 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.778950 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.779136 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.779255 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.779452 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.779577 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.779770 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.779907 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.780099 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.780224 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.780413 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.780553 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.780728 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.780855 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781020 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781145 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781313 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781450 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781644 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781769 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.781972 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782096 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782281 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782415 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782542 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782682 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782805 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.782937 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.783108 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.783236 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.783436 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.783564 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.783720 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.783844 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784029 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784156 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784349 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784478 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784661 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784797 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.784997 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785126 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785249 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785383 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785578 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785720 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785845 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.785967 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.786088 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.786215 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.786398 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.786525 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.786705 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.786831 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787012 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787138 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787320 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787447 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787626 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787840 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.787974 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.788097 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.788226 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.788400 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.788525 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.788748 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.788940 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.789103 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.789243 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.789421 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.789548 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.789741 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.789872 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.790079 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.790204 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.790367 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.790499 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.791187 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.791319 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.791510 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.791636 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.791839 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.792193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.792322 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.792496 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.792631 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.792761 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.792884 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.793088 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.793214 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.793401 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.793539 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.793729 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.793862 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794043 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794175 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794356 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794483 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794669 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794803 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.794976 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.795109 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.795288 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.795421 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.795563 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.795750 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.795875 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796003 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796135 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796267 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796430 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796564 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796739 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.796865 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797069 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797195 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797366 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797500 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797670 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797796 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.797976 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.798102 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.798286 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.798413 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.798594 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.798727 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.798902 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799028 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799209 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799345 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799515 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799649 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799823 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.799956 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.800129 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.800261 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.800436 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.800574 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.800756 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.800881 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.801091 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.801226 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.801407 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.801542 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.801711 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.801843 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802015 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802142 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802321 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802457 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802642 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802775 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.802948 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.803073 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.803251 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.803396 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.803570 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.803696 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.803876 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804002 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804183 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804321 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804491 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804617 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804795 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.804973 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.805109 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.805245 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.805430 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.805558 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.805801 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.805935 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.806067 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.806191 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.806420 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.807081 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.807322 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.807441 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.807724 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.807852 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.808064 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.808202 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.808383 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.808517 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.808701 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.808830 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.809059 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.809227 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.809361 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.809484 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.809665 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.809827 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.809968 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.810098 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.810263 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.810396 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.810585 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.810711 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.810895 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.811021 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.811204 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.811396 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.811583 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.811709 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.811907 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:11:10.812040 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.812247 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.812384 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.812582 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.812709 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.812947 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.813078 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.813266 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.813401 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.813599 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.813718 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.813924 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.814048 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.814243 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.814369 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.814556 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.814681 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.814870 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.815004 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.815193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.815319 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.815507 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.815632 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.815858 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816060 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816196 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816320 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816442 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816571 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816724 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.816852 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.817080 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.817215 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.817399 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.817526 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.817716 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.817842 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818035 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818164 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818350 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818483 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818668 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818795 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.818995 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.819122 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.819314 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.819439 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.819625 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.819761 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.819965 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.820088 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.820288 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.820407 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.820602 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.820741 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.820940 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.821072 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.821771 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.822956 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823088 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823222 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823346 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823470 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823592 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823713 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823824 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.823824 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824070 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824194 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824315 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824440 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824570 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824693 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824814 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.824954 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825077 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825198 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825425 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825560 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825683 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825812 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.825942 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826078 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826280 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826406 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826528 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826657 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826786 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.826915 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827046 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827174 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827296 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827416 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827536 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827669 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827791 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.827910 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828030 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828150 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828270 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828402 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828524 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828654 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828783 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.828959 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829081 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829214 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829337 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829456 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829576 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829697 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829817 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.829955 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.830077 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.830248 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.830372 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.830568 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.830701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.830884 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831015 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831215 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831343 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831527 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831658 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831838 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.831963 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.832142 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.832264 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.832457 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.832589 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.832772 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.832926 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.833106 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.833230 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.833432 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.833569 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.833748 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.833872 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834053 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834176 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834376 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834508 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834684 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834808 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.834991 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.835123 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.835306 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.835431 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.835623 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.835747 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.835935 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.836060 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.836322 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.836466 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.836590 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.836711 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.836861 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.837056 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.837193 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.837316 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.837578 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.837721 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.837944 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.838087 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.838259 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.838527 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.838654 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.838870 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839005 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839183 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839310 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839495 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839621 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839807 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.839940 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.840125 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.840260 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.840434 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.840559 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.840741 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.840866 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.841075 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.841203 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.841387 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.841512 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.841693 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.841899 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842026 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842149 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842301 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842435 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842609 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842745 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.842917 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.843044 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.843245 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.843379 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.843559 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.843699 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.843867 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844001 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844173 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844306 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844477 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844614 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844822 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.844986 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.845159 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.845288 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.845487 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.845621 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.845813 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.845940 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.846132 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.846271 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.846461 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.846598 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.846777 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.846878 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.847094 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.847192 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.847405 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.847505 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.847717 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.847814 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.848031 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.848145 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.848344 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.848443 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.848665 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.848762 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849027 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849126 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849342 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849432 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849658 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849755 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.849972 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.850067 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.850286 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.850385 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.850599 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.850701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.850907 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851034 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851228 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851329 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851540 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851629 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851865 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.851975 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.852183 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.852272 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.852505 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.852584 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.852819 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.852920 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.853675 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.853777 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.854170 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.854265 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.854427 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.854673 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.854754 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855002 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855083 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855322 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855409 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855651 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855745 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.855964 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.856051 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.856288 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.856373 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.856606 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.856684 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.856939 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857032 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857255 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857343 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857567 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857644 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857871 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.857946 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.858189 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.858279 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.858505 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.858596 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.858824 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.858924 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.859137 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.859228 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.859448 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.859538 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.859763 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.859851 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.860074 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.860164 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.860383 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.860472 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.860695 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.860783 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861038 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861136 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861342 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861436 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861658 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861756 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.861975 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.862066 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.862286 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.862426 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.862606 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.862761 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.862925 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863082 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863229 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863373 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863519 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863680 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863856 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.863996 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.864128 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.864287 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.864415 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.864557 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.864876 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865073 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865213 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865340 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865481 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865622 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865764 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.865896 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866024 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866162 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866315 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866445 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866607 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866734 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.866928 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.867085 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.867245 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.867460 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.867610 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.867754 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.867898 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.868055 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.868217 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.868363 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.868509 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.868663 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.868819 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.869590 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.869759 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.869961 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.870109 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.870315 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.870461 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.870624 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.870770 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.870914 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.871084 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.871242 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.871601 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.871762 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.871911 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.872056 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.872209 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.872209 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.872476 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.872726 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.872877 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873052 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873338 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873481 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873644 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873806 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.873948 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874096 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874240 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874397 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874543 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874686 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874831 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.874973 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.875116 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.875278 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.875423 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.875563 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.875707 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.875866 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.876022 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.876203 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.876371 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.876519 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.876665 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.876807 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877053 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877210 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877365 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877511 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877656 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877799 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.877942 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.878088 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.878249 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.878392 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.878577 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.878728 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.878875 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879021 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879221 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879381 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879529 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879687 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879844 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.879988 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.880134 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.880295 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.880694 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.880843 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.881067 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.881213 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.881367 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.881549 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.881722 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.881869 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882012 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882168 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882332 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882479 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882625 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882770 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.882917 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.883110 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.883270 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.883424 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.883580 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.883736 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.883890 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884033 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884187 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884335 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884477 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884614 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884758 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.884959 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.885141 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.885287 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.885588 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.885750 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.885909 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886069 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886223 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886378 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886525 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886673 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886818 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.886981 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.887126 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.887304 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.887514 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.887663 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.887811 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.887811 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888091 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888091 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888359 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888505 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888686 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888686 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888979 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.888979 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.889298 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.889445 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.889606 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.889753 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.889897 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890043 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890198 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890355 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890512 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890655 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890813 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.890962 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.891106 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.891284 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.891442 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.891598 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.891748 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.891894 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892039 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892195 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892340 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892487 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892631 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892787 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.892984 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.893151 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.893318 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.893461 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.893606 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.893753 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.893904 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894060 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894203 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894347 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894490 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894635 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894783 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.894940 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.895082 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.895225 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.895373 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.895542 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.895700 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.895846 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.896001 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.896145 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.896300 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.896446 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.896698 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.896858 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897085 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897237 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897396 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897539 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897680 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897827 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.897969 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.898125 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.898271 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.898412 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.898570 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.898715 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.898861 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899008 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899152 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899309 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899456 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899600 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899744 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.899891 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900035 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900195 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900342 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900468 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900599 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900746 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900930 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.900930 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.901226 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.901381 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.901525 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.901670 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.901814 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902038 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902185 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902328 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902474 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902617 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902770 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.902927 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903071 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903071 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903335 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903479 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903636 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903788 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.903941 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.904097 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.904241 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.904386 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.904544 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.904691 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.904955 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.905128 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.905272 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.905416 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.905574 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.905721 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.905859 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906003 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906150 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906310 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906455 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906599 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906744 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.906890 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907031 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907187 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907333 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907477 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907629 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907832 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.907976 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.908130 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.908276 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.908429 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.908575 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.908721 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.908862 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.909108 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.909253 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.909400 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.909558 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.909710 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.909855 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910015 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910160 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910306 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910448 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910604 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910768 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.910917 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.911060 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.911202 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.911358 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.911514 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.911683 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.911928 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.912130 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.912277 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.912435 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.912582 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.912747 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.912889 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.913120 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.913264 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.913408 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.913554 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.913720 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.913869 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914014 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914171 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914315 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914479 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914627 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914791 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.914999 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.915148 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.915148 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.915425 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.915581 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.916214 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.916344 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.916473 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.916625 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.916784 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.916784 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917072 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917219 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917219 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917482 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917648 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917797 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.917922 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918067 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918067 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918342 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918498 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918645 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918788 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.918931 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919088 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919246 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919390 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919533 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919678 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919820 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.919964 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.920121 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.920264 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.920407 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.920559 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.920705 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.920850 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921048 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921339 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921484 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921627 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921787 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.921931 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.922075 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.922203 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.922497 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.922653 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.922817 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.922974 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.923217 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.923360 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.923516 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.923670 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.923827 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.923981 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.924129 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.924273 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.924431 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.924577 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.924732 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.924887 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.925150 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.925297 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.925456 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.925697 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.925852 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.925995 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.926137 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.926282 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.926482 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.926651 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.926797 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.926941 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.927097 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.927245 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.927387 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.927544 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.927687 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.927835 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.928040 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.928193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.928338 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.928525 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.928691 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.928846 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929049 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929341 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929487 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929630 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929793 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.929948 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.930095 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.930242 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.930409 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.930571 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.930716 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.930860 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.931003 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.931146 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.931291 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.931998 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.932147 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.932275 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.932407 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.932554 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.932692 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.932943 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.933096 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.933243 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.933390 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.933569 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.933721 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.933890 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.934040 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.934183 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.934410 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.934577 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.934737 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.934891 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935044 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935247 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935394 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935539 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935696 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935849 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.935993 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.936170 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.936327 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.936481 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.936636 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.936781 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.936948 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937116 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937258 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937405 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937563 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937706 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937850 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.937992 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.938160 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.938322 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.938465 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.938620 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.938778 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.938922 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939066 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939222 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939369 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939514 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939655 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939800 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.939945 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.940101 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.940244 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.940399 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.940547 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.940693 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.940847 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941081 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941227 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941372 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941517 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941663 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941824 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.941981 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.942124 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.942265 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.942473 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.942618 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.942778 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.942923 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943067 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943212 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943362 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943520 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943681 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943825 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.943968 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.944118 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.944262 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.944409 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.944567 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.944714 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.944857 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945097 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945246 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945404 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945553 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945696 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945841 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.945988 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.946134 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.946289 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.946433 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.946579 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.946720 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.946863 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.947032 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.947193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.947506 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.947675 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.947825 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.947975 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.948120 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.948268 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.948457 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.948608 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.948749 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.948935 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.949103 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.949251 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.949405 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.949557 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.949701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.949848 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950004 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950150 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950296 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950452 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950595 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950738 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.950902 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951049 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951200 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951345 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951488 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951634 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951791 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.951965 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.952117 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.952261 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.952407 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.952557 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.952704 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.952845 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.953026 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.953171 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.953316 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.953630 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.953780 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.953924 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.954070 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.954250 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.954404 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.954561 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.954709 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.954863 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955008 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955152 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955297 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955473 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955629 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955776 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.955922 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.956095 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.956257 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.956411 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.956569 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.956766 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.956957 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.957105 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.957275 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.957422 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.957568 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.957714 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.957867 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958082 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958245 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958404 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958552 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958695 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958839 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.958999 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.959145 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.959318 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.959480 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.959663 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.959813 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.959979 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.960123 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.960268 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.960417 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.960560 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.960724 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.960873 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.961110 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.961258 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.961403 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.961549 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.961949 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.962126 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.962296 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.962446 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.962677 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.962822 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.962983 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.963127 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.963291 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.963291 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.963562 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.963723 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.963877 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.964060 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.964270 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.964439 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.964584 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.964746 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.964918 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.965050 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.965193 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.965338 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.965561 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.965712 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.965869 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966016 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966162 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966311 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966483 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966638 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966784 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.966916 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.967101 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.967254 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.967409 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.967553 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.967701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.967860 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968004 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968153 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968314 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968463 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968610 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968756 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.968985 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.969257 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.969409 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.969555 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.969698 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.969840 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.969983 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.970148 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.970292 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.970436 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.970596 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.970742 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.970896 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.971060 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.971269 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.971425 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.971582 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.971729 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.971882 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.972050 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.972193 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.972337 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.972516 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.972681 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.972839 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973012 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973160 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973303 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973465 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973627 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973793 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.973943 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.974086 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.974241 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.974394 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.974552 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.974729 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.974873 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.975029 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.975177 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.975325 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.975481 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.975701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.975858 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.976021 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.976168 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.976330 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.976573 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.976722 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.976866 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977033 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977180 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977326 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977488 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977637 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977786 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.977942 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.978085 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.978734 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.978883 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.979176 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.979330 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.979538 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.979735 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.979898 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.980043 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.980228 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.980396 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.980543 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.980699 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.980860 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981042 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981187 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981331 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981490 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981638 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981796 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.981942 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.982087 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.982231 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.982375 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.982537 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.982696 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.982908 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983071 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983215 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983364 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983507 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983672 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983834 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.983999 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.984152 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.984302 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.984461 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.984614 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.984757 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.984922 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985069 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985214 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985376 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985519 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985665 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985797 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.985942 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.986093 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.986256 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.986419 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.986577 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.986726 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.986870 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987017 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987162 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987309 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987452 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987623 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987752 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.987980 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.988140 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.988302 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.988447 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.988636 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.988858 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989076 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989230 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989393 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989550 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989694 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989837 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.989991 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.990134 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.990291 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.990440 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.990584 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.990726 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.990886 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.991030 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.991181 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.991354 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.991507 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.991672 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.991822 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.992003 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.992164 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.992340 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.992491 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.992650 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.992808 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.993056 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.993207 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.993380 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.993526 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.993683 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.993882 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.994525 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.994666 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.994912 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.995079 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.995225 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.995462 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.995615 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.995762 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.995908 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.996093 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.996241 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.996400 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.996561 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.996708 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.996854 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.997107 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.997267 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.997413 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.997587 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.997731 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.997888 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998034 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998182 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998338 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998492 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998639 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998800 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.998946 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.999149 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.999300 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.999445 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.999593 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.999748 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:10.999903 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000060 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000207 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000351 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000509 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000658 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000805 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.000970 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.001118 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.001288 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.001448 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.001603 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.001761 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.001906 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.002052 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.002199 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.002354 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.002528 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.002680 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.002863 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003015 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003203 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003357 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003502 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003647 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003811 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.003976 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.004143 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.004290 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.004433 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.004592 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.004736 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.004881 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.005133 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.005280 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.005431 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.005836 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006042 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006187 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006345 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006500 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006648 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006793 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.006941 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.007200 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.007348 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.007495 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.007495 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.007761 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.007906 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008073 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008211 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008367 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008513 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008658 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008805 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.008992 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.009150 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.009278 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.009447 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.009593 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.009749 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.009905 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.010053 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.010380 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.010531 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.010679 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.010836 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.010993 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.011153 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.011302 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.011458 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.011603 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.011761 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.011968 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.012134 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.012283 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.012428 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.012575 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.012738 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.012925 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013074 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013207 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013353 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013516 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013662 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013810 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.013954 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014100 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014250 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014408 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014555 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014847 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.014990 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.015139 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.015298 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.015442 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.015587 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.015733 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.015878 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016048 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016197 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016348 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016491 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016635 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016791 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.016979 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.017130 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.017306 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.017454 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.017643 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.017805 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.017967 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.018112 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.018269 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.018421 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.018567 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.018731 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.018897 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 04:11:11.019054 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.019199 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.019526 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.019852 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.020179 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.020525 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.020841 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.021209 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.021536 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.021852 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.022167 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.022473 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:11:11.022717 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 04:11:11.043537 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_db.sqlalchemy.engines [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.047473 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.111767 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.context [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5(cell1) {{(pid=101896) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 04:11:11.112030 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.context [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5(cell1) {{(pid=101895) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 04:11:11.116094 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:11:11.116282 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_concurrency.lockutils [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:11:11.117729 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_concurrency.lockutils [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:11:11.117897 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:11:11.118558 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_concurrency.lockutils [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:11:11.118700 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:11:11.121042 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:11:11.121499 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_concurrency.lockutils [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:11:11.133158 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.138094 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_db.sqlalchemy.engines [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.139718 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.142239 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_db.sqlalchemy.engines [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.307148 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG oslo_db.sqlalchemy.engines [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.379379 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_db.sqlalchemy.engines [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:11:11.650822 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: WARNING keystonemiddleware.auth_token [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:11:11.657472 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: WARNING keystonemiddleware.auth_token [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:11:11.704621 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: WARNING keystonemiddleware.auth_token [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:11:11.711182 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: WARNING keystonemiddleware.auth_token [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:11:12.005385 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: WARNING keystonemiddleware.auth_token [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:11:12.011073 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: WARNING keystonemiddleware.auth_token [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:11:12.016261 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c62184c9c0 pid: 101895 (default app) Feb 15 04:11:12.018360 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:11:12.019523 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Feb 15 04:11:12.019939 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Tue Feb 15 04:11:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:11:12.064669 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: WARNING keystonemiddleware.auth_token [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:11:12.069901 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: WARNING keystonemiddleware.auth_token [None req-eb7c5138-40c6-4598-9c30-f02f7fab1598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:11:12.075280 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c62184c9c0 pid: 101896 (default app) Feb 15 04:12:38.826161 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:38.828289 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Feb 15 04:12:38.828629 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:39.340613 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-017ff8dc-10c5-45e6-93a7-a3326631757b admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:39.375668 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-017ff8dc-10c5-45e6-93a7-a3326631757b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.539549 Feb 15 04:12:39.376639 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Feb 15 04:12:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:12:42.143563 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:42.144557 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-41418095-9be1-46c4-ab5a-82a104d08fa7 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Feb 15 04:12:42.144974 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:12:42.212113 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-4ec5e27c-ae31-450e-bcf0-ebf6e1ef395a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:42.231099 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:12:42.231099 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: warnings.warn(msg) Feb 15 04:12:42.264564 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-4ec5e27c-ae31-450e-bcf0-ebf6e1ef395a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111992 Feb 15 04:12:42.265418 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:12:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:12:42.488104 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-ff3e202e-47b9-4cc8-a970-c591ac440229 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:42.491098 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:12:42.491098 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: warnings.warn(msg) Feb 15 04:12:42.543439 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-ff3e202e-47b9-4cc8-a970-c591ac440229 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269980 Feb 15 04:12:42.545279 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Feb 15 04:12:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:12:44.968836 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-4ec5e27c-ae31-450e-bcf0-ebf6e1ef395a admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:44.969903 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-4ec5e27c-ae31-450e-bcf0-ebf6e1ef395a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 15 04:12:44.970543 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:45.097825 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-fb62e352-f15f-4152-a97e-66489337a36b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:45.118221 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:12:45.118221 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: warnings.warn(msg) Feb 15 04:12:45.152276 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-fb62e352-f15f-4152-a97e-66489337a36b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.173860 Feb 15 04:12:45.154119 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:12:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:12:45.170887 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-39fd7863-6cab-449d-979b-a105e2c5b744 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:45.172699 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:12:45.172699 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: warnings.warn(msg) Feb 15 04:12:45.221205 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-39fd7863-6cab-449d-979b-a105e2c5b744 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058752 Feb 15 04:12:45.222538 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Feb 15 04:12:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:12:47.651771 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-fb62e352-f15f-4152-a97e-66489337a36b admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:47.653697 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-fb62e352-f15f-4152-a97e-66489337a36b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Feb 15 04:12:47.664406 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:47.728311 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-948d0fbb-24d7-4baf-9006-c4d88f30d734 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "vcpus": 1, "name": "ds1G", "ram": 1024, "disk": 10}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:47.750291 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-948d0fbb-24d7-4baf-9006-c4d88f30d734 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088951 Feb 15 04:12:47.765583 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-438eea06-c272-4e95-91e1-2992ccd63c0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:47.769666 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:12:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:12:47.805241 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-438eea06-c272-4e95-91e1-2992ccd63c0e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042968 Feb 15 04:12:47.815679 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Feb 15 04:12:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:12:50.479707 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-948d0fbb-24d7-4baf-9006-c4d88f30d734 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:50.480852 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-948d0fbb-24d7-4baf-9006-c4d88f30d734 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Feb 15 04:12:50.481293 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:50.557720 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-ee064e37-77c6-4d7b-9236-94cd22947702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G"}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:50.589157 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-ee064e37-77c6-4d7b-9236-94cd22947702 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101016 Feb 15 04:12:50.590168 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:12:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:12:50.612502 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-0415ee4d-9e92-4180-8e16-197c0b222a9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:50.655065 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-0415ee4d-9e92-4180-8e16-197c0b222a9a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050659 Feb 15 04:12:50.656130 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Feb 15 04:12:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:12:53.179198 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-ee064e37-77c6-4d7b-9236-94cd22947702 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:53.181143 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-ee064e37-77c6-4d7b-9236-94cd22947702 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003081 Feb 15 04:12:53.182151 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:53.247872 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-d467992b-5d74-4841-9425-def70a8ad189 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:53.273189 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-d467992b-5d74-4841-9425-def70a8ad189 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083834 Feb 15 04:12:53.273966 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:12:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:12:53.285735 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-dc7e020c-167b-4141-af1a-32821fd37091 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:53.311977 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-dc7e020c-167b-4141-af1a-32821fd37091 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029822 Feb 15 04:12:53.312565 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Feb 15 04:12:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:12:56.197965 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-d467992b-5d74-4841-9425-def70a8ad189 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:56.199600 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-d467992b-5d74-4841-9425-def70a8ad189 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Feb 15 04:12:56.200295 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:56.276568 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-5553117e-932e-47c1-85c5-4feb47054b21 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:56.306575 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-5553117e-932e-47c1-85c5-4feb47054b21 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.098456 Feb 15 04:12:56.308947 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Feb 15 04:12:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:12:59.164744 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-d467992b-5d74-4841-9425-def70a8ad189 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:12:59.165793 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-d467992b-5d74-4841-9425-def70a8ad189 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Feb 15 04:12:59.166207 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:12:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:12:59.238504 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-c28d5c5c-a302-4570-a842-780a353d535f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "vcpus": 1, "disk": 1, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:59.260826 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-c28d5c5c-a302-4570-a842-780a353d535f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088467 Feb 15 04:12:59.268701 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:12:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:12:59.273526 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-48643b83-69a5-4dd8-969b-c9b5813e47d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:12:59.299917 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-48643b83-69a5-4dd8-969b-c9b5813e47d1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029761 Feb 15 04:12:59.304938 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Feb 15 04:12:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:13:01.611824 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-c28d5c5c-a302-4570-a842-780a353d535f admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:01.612831 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-c28d5c5c-a302-4570-a842-780a353d535f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Feb 15 04:13:01.613227 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:13:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:01.680615 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-a545f2c4-e232-4297-9dad-241cf3c4b7b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:01.703554 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-a545f2c4-e232-4297-9dad-241cf3c4b7b1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084056 Feb 15 04:13:01.704467 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:13:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:13:01.719570 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-72810602-7c8a-4cf4-a5ef-d5c3ce4ceb44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:01.749960 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-72810602-7c8a-4cf4-a5ef-d5c3ce4ceb44 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035455 Feb 15 04:13:01.750841 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Feb 15 04:13:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:13:04.091143 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-a545f2c4-e232-4297-9dad-241cf3c4b7b1 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:04.092168 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-a545f2c4-e232-4297-9dad-241cf3c4b7b1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Feb 15 04:13:04.092723 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:13:04.153619 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-47670fdd-7453-447d-8032-ea2862e52c53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "disk": 40}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:04.174523 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-47670fdd-7453-447d-8032-ea2862e52c53 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075844 Feb 15 04:13:04.175097 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:13:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:13:04.187684 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-bd499ff3-403d-4424-8576-a0f6b1182fc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:04.213397 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-bd499ff3-403d-4424-8576-a0f6b1182fc4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029218 Feb 15 04:13:04.213981 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Feb 15 04:13:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:13:06.521038 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-47670fdd-7453-447d-8032-ea2862e52c53 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:06.522803 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-47670fdd-7453-447d-8032-ea2862e52c53 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002598 Feb 15 04:13:06.523523 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:13:06.592474 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-5ea49ce3-df11-4d6f-9773-42e780756907 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "swap": 0, "id": "4"}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:06.612734 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-5ea49ce3-df11-4d6f-9773-42e780756907 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081132 Feb 15 04:13:06.613476 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:13:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:13:06.624959 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-e59d5d7f-4989-4ff9-811e-3ed36c94c0b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:06.649485 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-e59d5d7f-4989-4ff9-811e-3ed36c94c0b5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028118 Feb 15 04:13:06.650071 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Feb 15 04:13:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:13:09.000702 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-5ea49ce3-df11-4d6f-9773-42e780756907 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:09.002401 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-5ea49ce3-df11-4d6f-9773-42e780756907 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Feb 15 04:13:09.002803 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:09.074805 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-b45d07bb-96e1-4d64-8c33-5fe27ad4630f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0, "disk": 160, "vcpus": 8}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:09.094882 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-b45d07bb-96e1-4d64-8c33-5fe27ad4630f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.085367 Feb 15 04:13:09.095561 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Feb 15 04:13:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:13:09.108601 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-0062c7a9-efa5-400f-a9e5-3feb4c932197 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:09.134366 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-0062c7a9-efa5-400f-a9e5-3feb4c932197 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029465 Feb 15 04:13:09.135077 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Feb 15 04:13:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:13:35.139933 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-b45d07bb-96e1-4d64-8c33-5fe27ad4630f admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:35.141006 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-b45d07bb-96e1-4d64-8c33-5fe27ad4630f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Feb 15 04:13:35.141434 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:35.207637 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-5a1dc278-88ec-4660-9234-08f9d3262b42 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:35.228736 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-5a1dc278-88ec-4660-9234-08f9d3262b42 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079586 Feb 15 04:13:35.229348 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Feb 15 04:13:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:13:36.638338 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-b45d07bb-96e1-4d64-8c33-5fe27ad4630f admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:36.639356 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-b45d07bb-96e1-4d64-8c33-5fe27ad4630f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Feb 15 04:13:36.639760 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:36.832257 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-4e41b79d-9458-40b6-a8c8-0fe18cb90083 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:36.837937 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.wsgi [None req-4e41b79d-9458-40b6-a8c8-0fe18cb90083 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 15 04:13:36.838511 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-4e41b79d-9458-40b6-a8c8-0fe18cb90083 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:13:36.839311 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-4e41b79d-9458-40b6-a8c8-0fe18cb90083 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059392 Feb 15 04:13:36.839836 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Feb 15 04:13:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:36.849794 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-0b7ae10b-64fb-4741-9529-04520d7e462d admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:36.870951 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-0b7ae10b-64fb-4741-9529-04520d7e462d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025328 Feb 15 04:13:36.871514 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Feb 15 04:13:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:13:36.882253 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-4926a396-0e6e-47be-a54b-07f0a244afed admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:36.903883 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-4926a396-0e6e-47be-a54b-07f0a244afed admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026150 Feb 15 04:13:36.904434 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Feb 15 04:13:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:13:36.913875 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-03542701-e0a4-4469-8aa5-65642edae74d admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:36.919419 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.wsgi [None req-03542701-e0a4-4469-8aa5-65642edae74d admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 15 04:13:36.920022 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-03542701-e0a4-4469-8aa5-65642edae74d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:13:36.920827 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-03542701-e0a4-4469-8aa5-65642edae74d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010642 Feb 15 04:13:36.921378 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Feb 15 04:13:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:38.281823 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-4926a396-0e6e-47be-a54b-07f0a244afed admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:38.282837 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-4926a396-0e6e-47be-a54b-07f0a244afed admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Feb 15 04:13:38.283237 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:38.508243 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-721e7236-d73c-4150-a139-5cf681acf887 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:38.515635 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.wsgi [None req-721e7236-d73c-4150-a139-5cf681acf887 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 15 04:13:38.516209 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-721e7236-d73c-4150-a139-5cf681acf887 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:13:38.517419 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-721e7236-d73c-4150-a139-5cf681acf887 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071495 Feb 15 04:13:38.518353 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Feb 15 04:13:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:38.527800 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-f4ba4736-1013-449e-8d70-97e42aa40991 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:38.541914 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-f4ba4736-1013-449e-8d70-97e42aa40991 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017665 Feb 15 04:13:38.542451 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Feb 15 04:13:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:13:38.552574 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-bc56b6fe-7aa7-4918-a30a-ad442b6a6aa3 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:38.566104 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-bc56b6fe-7aa7-4918-a30a-ad442b6a6aa3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017621 Feb 15 04:13:38.566650 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Feb 15 04:13:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:13:38.576316 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-cfb8468c-dd9a-4c0a-847e-99a7d107e827 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:38.581890 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.wsgi [None req-cfb8468c-dd9a-4c0a-847e-99a7d107e827 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 15 04:13:38.582472 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-cfb8468c-dd9a-4c0a-847e-99a7d107e827 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:13:38.583333 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-cfb8468c-dd9a-4c0a-847e-99a7d107e827 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010762 Feb 15 04:13:38.583857 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Feb 15 04:13:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:39.884880 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-bc56b6fe-7aa7-4918-a30a-ad442b6a6aa3 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:39.885915 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-bc56b6fe-7aa7-4918-a30a-ad442b6a6aa3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Feb 15 04:13:39.886314 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:40.083634 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-0dac70c6-1b15-4a8b-ba54-0e45269ec3c1 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:40.088834 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.wsgi [None req-0dac70c6-1b15-4a8b-ba54-0e45269ec3c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 15 04:13:40.089436 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-0dac70c6-1b15-4a8b-ba54-0e45269ec3c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:13:40.090232 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-0dac70c6-1b15-4a8b-ba54-0e45269ec3c1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060286 Feb 15 04:13:40.090750 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Feb 15 04:13:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:40.100449 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-59be6f79-8198-46ca-a572-52dee8284bfc admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:40.114357 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-59be6f79-8198-46ca-a572-52dee8284bfc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017794 Feb 15 04:13:40.114929 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Feb 15 04:13:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:13:40.124887 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:40.138891 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017888 Feb 15 04:13:40.139525 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Feb 15 04:13:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:13:40.150129 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-8f6f1d94-626b-49d4-87fa-219472d42652 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:40.155524 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.wsgi [None req-8f6f1d94-626b-49d4-87fa-219472d42652 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 15 04:13:40.156095 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-8f6f1d94-626b-49d4-87fa-219472d42652 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:13:40.156915 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-8f6f1d94-626b-49d4-87fa-219472d42652 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011346 Feb 15 04:13:40.157619 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Feb 15 04:13:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:41.452757 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:41.453797 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Feb 15 04:13:41.454195 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:41.652407 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-0662bca7-4380-4153-84de-4abec703deaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:41.671043 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-0662bca7-4380-4153-84de-4abec703deaa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070816 Feb 15 04:13:41.671518 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Feb 15 04:13:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:13:42.980498 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:42.981550 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Feb 15 04:13:42.981949 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:43.175494 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-ad10e217-50ba-4bd3-8052-40e8c559f25c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:43.193890 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-ad10e217-50ba-4bd3-8052-40e8c559f25c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071199 Feb 15 04:13:43.194395 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Feb 15 04:13:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:13:44.498028 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:44.498529 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Feb 15 04:13:44.498949 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:44.690038 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-35a5f830-deb9-4e0f-90f3-115e63581cbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:44.709976 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-35a5f830-deb9-4e0f-90f3-115e63581cbf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072290 Feb 15 04:13:44.710692 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Feb 15 04:13:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:13:46.022777 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:46.023791 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Feb 15 04:13:46.024191 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:46.220716 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-69554d8c-1e6a-4058-aef9-058a672a3a11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:13:46.239208 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-69554d8c-1e6a-4058-aef9-058a672a3a11 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073296 Feb 15 04:13:46.239549 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Feb 15 04:13:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:13:47.543883 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:47.544967 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Feb 15 04:13:47.545364 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:13:47.737678 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-a7b85528-f133-46cf-9fc3-314b6d4acf6f admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:13:47.757958 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-a7b85528-f133-46cf-9fc3-314b6d4acf6f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072954 Feb 15 04:13:47.759075 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Tue Feb 15 04:13:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:14:34.231125 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:14:34.232142 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-efb2de01-fcb6-449b-9837-d74365b95903 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Feb 15 04:14:34.232541 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Tue Feb 15 04:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:14:34.293867 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-2410846b-cdb3-4a2c-8cf4-a07a289fe71c admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:14:34.313873 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-2410846b-cdb3-4a2c-8cf4-a07a289fe71c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074445 Feb 15 04:14:34.314412 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Feb 15 04:14:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:14:34.337233 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-1e65aacc-a52f-4d96-8173-45b3e4bd2127 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:14:34.345032 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-1e65aacc-a52f-4d96-8173-45b3e4bd2127 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011316 Feb 15 04:14:34.345575 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Tue Feb 15 04:14:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:14:34.357674 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-9b9fe733-a57b-41b7-b3f4-1b2ff50bdb62 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:14:34.366290 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-9b9fe733-a57b-41b7-b3f4-1b2ff50bdb62 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012206 Feb 15 04:14:34.366816 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Tue Feb 15 04:14:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:14:34.378332 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-6a36d1e7-0c2b-4336-b6c0-950ae7815e1a admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:14:34.385988 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-6a36d1e7-0c2b-4336-b6c0-950ae7815e1a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011420 Feb 15 04:14:34.386504 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Tue Feb 15 04:14:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:14:34.398839 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:14:34.406385 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012133 Feb 15 04:14:34.406896 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Tue Feb 15 04:14:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:16:05.155950 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-cb3adf90-811c-413b-88fb-1888d485756a tempest-verify_tempest_config-656793521 tempest-verify_tempest_config-656793521-project] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:16:05.157950 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-cb3adf90-811c-413b-88fb-1888d485756a tempest-verify_tempest_config-656793521 tempest-verify_tempest_config-656793521-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113008 Feb 15 04:16:05.158497 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 34/69] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Feb 15 04:16:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:17:36.983574 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:36.984593 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Feb 15 04:17:36.985008 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 36/70] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:17:37.248212 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-30ffe45d-f3ca-47d6-91cd-f8e7737d392f admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:37.249432 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:17:37.249432 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: warnings.warn(msg) Feb 15 04:17:37.250972 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-30ffe45d-f3ca-47d6-91cd-f8e7737d392f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:37.251682 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-30ffe45d-f3ca-47d6-91cd-f8e7737d392f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:37.253114 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-30ffe45d-f3ca-47d6-91cd-f8e7737d392f admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:37.253557 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-30ffe45d-f3ca-47d6-91cd-f8e7737d392f admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:37.288793 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-30ffe45d-f3ca-47d6-91cd-f8e7737d392f admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152937 Feb 15 04:17:37.289613 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 35/71] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Feb 15 04:17:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:17:38.599380 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:38.600385 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Feb 15 04:17:38.600779 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 37/72] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:17:38.802209 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-243d6e90-d4d4-4f4d-b6af-3330390edc29 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:38.803381 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:17:38.803381 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: warnings.warn(msg) Feb 15 04:17:38.804913 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-243d6e90-d4d4-4f4d-b6af-3330390edc29 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:38.805370 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-243d6e90-d4d4-4f4d-b6af-3330390edc29 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:38.806168 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-243d6e90-d4d4-4f4d-b6af-3330390edc29 admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:38.806610 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-243d6e90-d4d4-4f4d-b6af-3330390edc29 admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:38.825196 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-243d6e90-d4d4-4f4d-b6af-3330390edc29 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075706 Feb 15 04:17:38.825751 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 36/73] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Feb 15 04:17:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:17:50.580465 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:50.582257 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Feb 15 04:17:50.582560 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 38/74] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:17:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:17:50.775059 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-7d528abd-1a57-48d8-a527-d2185f571504 admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:50.776202 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:17:50.776202 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: warnings.warn(msg) Feb 15 04:17:50.777738 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-7d528abd-1a57-48d8-a527-d2185f571504 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:50.778179 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-7d528abd-1a57-48d8-a527-d2185f571504 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:50.778977 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-7d528abd-1a57-48d8-a527-d2185f571504 admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:50.779403 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-7d528abd-1a57-48d8-a527-d2185f571504 admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:50.803761 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-7d528abd-1a57-48d8-a527-d2185f571504 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080918 Feb 15 04:17:50.804242 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 37/75] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Feb 15 04:17:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:17:52.092450 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: DEBUG nova.api.openstack.wsgi [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] Calling method '>' {{(pid=101895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:52.093497 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: INFO nova.api.openstack.requestlog [None req-5fd52cbb-c2aa-428c-9d20-90fd66ff9b16 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 15 04:17:52.093903 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: [pid: 101895|app: 0|req: 39/76] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Feb 15 04:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:17:52.286092 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG nova.api.openstack.wsgi [None req-298237b2-6477-4314-bca9-42426af05cca admin admin] Calling method '>' {{(pid=101896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:17:52.287252 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:17:52.287252 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: warnings.warn(msg) Feb 15 04:17:52.288909 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-298237b2-6477-4314-bca9-42426af05cca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:52.289373 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-298237b2-6477-4314-bca9-42426af05cca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:52.290209 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-298237b2-6477-4314-bca9-42426af05cca admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:17:52.290701 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: DEBUG oslo_concurrency.lockutils [None req-298237b2-6477-4314-bca9-42426af05cca admin admin] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:17:52.311944 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: INFO nova.api.openstack.requestlog [None req-298237b2-6477-4314-bca9-42426af05cca admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078766 Feb 15 04:17:52.312439 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: [pid: 101896|app: 0|req: 38/77] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Feb 15 04:17:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:18:51.734544 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: Tue Feb 15 04:18:51 2022 - graceful shutdown triggered... Feb 15 04:18:51.735062 dv-cinder-816104-2-iscsi devstack@n-api.service[101896]: Gracefully killing worker 2 (pid: 101896)... Feb 15 04:18:51.734639 dv-cinder-816104-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 15 04:18:51.735884 dv-cinder-816104-2-iscsi devstack@n-api.service[101895]: Gracefully killing worker 1 (pid: 101895)... Feb 15 04:18:52.735682 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: worker 1 buried after 1 seconds Feb 15 04:18:52.736153 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: worker 2 buried after 1 seconds Feb 15 04:18:52.736153 dv-cinder-816104-2-iscsi devstack@n-api.service[101894]: goodbye to uWSGI. Feb 15 04:18:52.737526 dv-cinder-816104-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 15 04:18:52.738077 dv-cinder-816104-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 15 04:18:52.741260 dv-cinder-816104-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 15 04:18:52.757572 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 15 04:18:52.760641 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 04:18:52 2022] *** Feb 15 04:18:52.760641 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 04:18:52.760641 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 04:18:52.760641 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: nodename: dv-cinder-816104-2-iscsi Feb 15 04:18:52.760641 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: machine: x86_64 Feb 15 04:18:52.760641 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: clock source: unix Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: pcre jit disabled Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: detected number of CPU cores: 4 Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: current working directory: / Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: detected binary path: /usr/bin/uwsgi-core Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: your processes number limit is 47680 Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: your memory page size is 4096 bytes Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: detected max file descriptor number: 2048 Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: lock engine: pthread robust mutexes Feb 15 04:18:52.761144 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: thunder lock: enabled Feb 15 04:18:52.761751 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 15 04:18:52.761751 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 04:18:52.807580 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: Python main interpreter initialized at 0x56500c6a39c0 Feb 15 04:18:52.807580 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: python threads support enabled Feb 15 04:18:52.807580 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: your server socket listen backlog is limited to 100 connections Feb 15 04:18:52.807580 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: your mercy for graceful operations on workers is 90 seconds Feb 15 04:18:52.808038 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 04:18:52.808038 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: *** Operational MODE: preforking *** Feb 15 04:18:52.808289 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: *** uWSGI is running in multiple interpreter mode *** Feb 15 04:18:52.808289 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: spawned uWSGI master process (pid: 116286) Feb 15 04:18:52.808500 dv-cinder-816104-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 15 04:18:52.809225 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: spawned uWSGI worker 1 (pid: 116304, cores: 1) Feb 15 04:18:52.809490 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: spawned uWSGI worker 2 (pid: 116305, cores: 1) Feb 15 04:18:52.809705 dv-cinder-816104-2-iscsi devstack@n-api.service[116286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 04:18:54.758035 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:18:54.758035 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: from cryptography.utils import int_from_bytes Feb 15 04:18:54.758730 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:18:54.758730 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: from cryptography.utils import int_from_bytes Feb 15 04:18:54.801312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:18:54.801312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: from cryptography.utils import int_from_bytes Feb 15 04:18:54.802657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:18:54.802657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: from cryptography.utils import int_from_bytes Feb 15 04:18:57.242900 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 04:18:57.243483 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 04:18:57.243688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 04:18:57.244056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 04:18:57.244317 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 04:18:57.244725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.245086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.245417 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.245745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.246080 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.246398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.246728 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.247056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.247390 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.247659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.247986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.248315 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816104-2-iscsi {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.248644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.248986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.249310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.249640 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.250205 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.250539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.250853 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.251354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.251811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.252165 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.252447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.253359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.253359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.253563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.253787 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.254107 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.255031 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.255328 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.255716 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816104-2-iscsi {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.256072 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.256350 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.256670 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.257132 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.257447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.262831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.263559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.263559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.263559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.263559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.263899 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.264108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.264439 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.264751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.265217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.265543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.265862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.266176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.266689 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.267012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.267326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.267660 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.267988 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.268324 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.268641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.268995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.269411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.269671 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.269990 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.271072 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.271396 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.271718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.272048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.272379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.272696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.273039 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.273359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.273692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.274040 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.274449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.274608 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.274913 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.275229 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.275555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.275869 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.276182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.276493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.276800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.277142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.277461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.277770 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.278084 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.278404 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.278714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.279027 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.279342 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.279657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.279985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.280313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.280627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.280959 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.281274 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.281590 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.281922 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.282232 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.282546 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.282876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.283188 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.283502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.283835 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.284150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.284586 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.284749 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 04:18:57.285353 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.285452 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 04:18:57.285579 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.285579 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.285823 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 04:18:57.285914 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.285997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 04:18:57.286076 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.286225 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 04:18:57.286378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.286508 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.286785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.286894 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.287106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.287207 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.287426 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.287567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.287739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.287836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.288071 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.288209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.288367 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.288588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.288964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.289096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.289210 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.289351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.289351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.289656 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.289843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.290021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.290196 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816104-2-iscsi {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.290371 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.290567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.290772 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.290981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.291180 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.291382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.291576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.291771 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.291957 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.292141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.292330 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.292535 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.292714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.292976 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.293108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.293234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.293460 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.293584 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.293763 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.297071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.297155 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.297249 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.297333 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.297415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.297498 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.297583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.297660 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.297738 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.297808 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.297888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.297972 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.298043 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.298119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.298195 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.298277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.298359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.298446 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.298517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816104-2-iscsi {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.298595 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.298690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.298774 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.298854 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.298925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299001 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299071 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299071 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299284 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299360 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299508 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299590 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299667 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299744 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.299823 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299823 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.299955 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.300110 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300181 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.300256 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.300401 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.300553 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.300688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.300830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.300983 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.301073 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.301373 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.301557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.301795 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.302385 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.302492 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.302574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.302652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.302733 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.302803 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.302872 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.303013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.303149 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.303337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.303477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.303661 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.303751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.303973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.304061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.304294 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.304375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.304758 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.304882 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.305371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.305457 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.305528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.305604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.305684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.305762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.305840 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.305917 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.306303 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.306397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.306484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.306555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.306728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.306817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.307038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.307142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.307358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.307447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.307676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.307756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.308001 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.308088 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.308310 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.308397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.308631 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.308711 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.309045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.310080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310236 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.310315 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.310470 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.310625 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310693 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.310768 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.310913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.310997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.311150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.311239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.311524 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.311626 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.311764 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.311861 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.312072 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.312150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.312394 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.312485 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.312705 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.312785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.313232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.313722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.313797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.313867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.313949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.314033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.314105 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.314173 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.314241 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.314318 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.314501 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.314583 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.314941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.315044 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.315128 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.315283 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.315404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.315501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.315907 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.316059 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.316300 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.316567 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.316731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.316874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.317935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.318124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.318266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.318418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.318678 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.318825 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.318973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.319125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.319274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.319274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.319561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.319715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.319853 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.320000 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.320137 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.320287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.320436 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.320585 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.320732 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.320888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.321054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.321213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.321352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.321502 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.321812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.321972 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.322121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.322260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.322396 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.322549 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.322694 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.322832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.322978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.323113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.323259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.323410 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.323557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.323694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.323839 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.323976 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.324069 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.324239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.324386 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.324536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.324687 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.324837 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.325323 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.325479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.325479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.325750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.325899 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.326049 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.326194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.326442 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.326611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.326706 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.327006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.327156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.327304 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.327452 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.327602 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.327749 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.328111 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.328254 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.328391 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.328537 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.328681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.328818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.328981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.329119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.329266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.329423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.329560 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.329696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.329843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.329979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.330135 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:18:57.330278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.330427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.330564 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.330724 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.330873 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.331030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.337519 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.337699 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.337784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.337857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.337929 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338270 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338426 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338511 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338739 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338893 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.338965 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339256 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339409 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339638 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339793 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.339865 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340021 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340096 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340266 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340422 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340653 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.340925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345251 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345347 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345442 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345518 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345589 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345668 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345740 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.345926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346456 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346608 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346689 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.346861 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349725 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349894 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.349975 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350207 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350276 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350354 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350426 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350502 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350590 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350669 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350741 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350741 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.350955 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351095 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351511 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351893 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.351970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.352041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355223 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355350 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.355930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356082 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356158 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356228 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356304 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356642 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.356864 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357300 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357300 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357505 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357619 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357695 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357775 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357846 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357915 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.357983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358567 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358649 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358789 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358875 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.358947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359094 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359203 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359472 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359544 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359613 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359975 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359975 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.359975 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.360854 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361206 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361206 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361588 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361671 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361829 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361899 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.361997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362068 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362294 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362674 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362779 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.362854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363186 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363274 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363514 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363585 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.363803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.368573 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.368573 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.368752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.368752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.368920 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369408 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369572 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369809 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.369967 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370740 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.370886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371104 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371184 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371323 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371467 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371618 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371766 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371766 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.371973 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372264 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372579 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372650 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372795 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.372872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.373974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374220 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374220 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374686 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374686 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.374846 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375195 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375270 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375406 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375487 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375565 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.375932 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376138 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376282 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376360 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376509 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.376727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.382596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.382790 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.382954 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.383097 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.383267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.383752 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.383909 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.384920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385371 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385530 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.385964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386100 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386244 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386536 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.386978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387558 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387704 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387704 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.387973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.388121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.388121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.388392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.388540 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.388815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389023 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389023 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389301 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389729 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.389877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.390024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.390163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.390675 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.390831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.390990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.391129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.391275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.391421 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.391560 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.391822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.392285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.392440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.392581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.392727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.392865 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.393019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.393167 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.393314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.393314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.393904 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394206 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394510 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394656 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.394953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.395127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.395787 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.396488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.396646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.396796 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.396995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.397145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.397294 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.397455 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.397603 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.397750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.397889 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398034 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398309 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398454 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.398897 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399035 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399457 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.399883 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.400020 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.400169 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.400314 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.400842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401015 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401153 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401301 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.401750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.402131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.402576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.402725 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.402863 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.403013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.403160 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.403299 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.403435 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.403571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404221 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404645 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404793 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.404966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405105 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405244 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405380 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405516 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405663 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.405965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406252 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406400 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406548 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.406958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407094 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407241 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.407982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.408132 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.408287 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.408425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.408561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.408698 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.408842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409906 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.409993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410144 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410229 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410301 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.410803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.411173 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.411822 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.411908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.412119 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.412209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.412290 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.412670 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.412848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413016 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413167 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413483 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413562 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413639 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.413795 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.414234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.414321 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.414394 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.414464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415152 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415566 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415644 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415644 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.415785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416347 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416494 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416631 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416784 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.416948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.417208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.417344 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.417507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.417646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.417798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.417936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418295 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418440 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.418988 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419136 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419294 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419566 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419714 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419850 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.419986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.420272 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.420421 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.420557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421097 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421264 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421412 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421560 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421832 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.421982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.422248 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.422407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.422554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.422996 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.423132 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.423269 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.423417 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.423565 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.423777 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.423936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424427 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424631 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424789 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.424971 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425059 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425137 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425588 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.425969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.426041 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.426110 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.426185 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.426257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.426845 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.426933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.427005 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.427074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.427294 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.427908 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428465 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428548 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428783 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.428854 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429321 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429402 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429775 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.429932 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430297 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430451 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430537 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430609 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430692 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.430763 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431376 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431651 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431728 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.431936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432403 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.432715 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433306 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433553 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433708 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.433930 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.434008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.434088 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.434165 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.434257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.434867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.434969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435269 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435576 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435892 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.435964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436196 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436275 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436560 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436631 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436709 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.436935 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437080 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.437974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438327 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438560 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.438805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439828 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439911 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.439997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.440261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.440348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.440614 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.440717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.441571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.441670 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.441758 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.443579 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.443665 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.443744 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.443826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.443898 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.443976 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444304 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444834 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.444834 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445166 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445166 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445921 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.445990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.446175 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.446266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.446491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.446592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.446810 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.446901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.447124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.447215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.447443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.447545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.447761 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.447863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.448084 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.448175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.448405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.448485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.448736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.448823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.449552 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.449714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.449892 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.450039 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.450190 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.450340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.450499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.450682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.450848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.451049 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.451216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.451463 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.451815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.451976 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.452120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.452261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.452413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.452572 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.452756 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.452955 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.453117 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.453268 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.453791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.453954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.454107 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.454257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.454418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.454561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.454719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.455202 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.455349 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.455499 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.455643 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.455793 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.455950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.456094 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.456244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.456394 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.456563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.456707 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.456874 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.457123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.457279 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.457421 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.457602 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.457753 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.458536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.458536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.458826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.458971 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.459191 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.459366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.459518 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.459668 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.459817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.459959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.460108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.460266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.460410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.460552 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.460694 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.460846 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.461022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.461022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.461320 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.461479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.461734 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.462087 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.462245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.462456 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.462656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.462810 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.462963 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.463106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.463324 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.463487 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.464003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.464170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.464325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.464469 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.464626 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.464778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.465275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.465430 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.465582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.465726 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.465878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466030 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466365 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466516 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.466985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.467142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.467372 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.467523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.467675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.467826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.467968 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.468119 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.468262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.468426 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.468582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.468735 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.468886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469064 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469369 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469520 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.469959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.470102 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.470276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.470507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.470662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.470805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.470947 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.471089 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.471242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.471444 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.471590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.471757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.471992 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.472287 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.472449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.472604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.472749 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.472915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.473065 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.473246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.473406 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.474325 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.474496 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.474652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.474799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.474941 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.475116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.475116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.475696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.475860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.475860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.476154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.476300 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.476443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.476593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.476737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.476888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477269 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477367 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477528 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477710 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477802 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.477969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478342 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478506 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478578 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478733 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.478956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.479033 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.479105 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.479204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.479289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.479362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480046 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480820 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480914 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.480990 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481146 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481305 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481851 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.481921 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482347 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482508 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482649 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.482806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.483055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.483372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.483555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.483688 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.483934 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.484026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.484415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.484512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.484632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.484713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.485329 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.485718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.485848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.485970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486201 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486717 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.486946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487066 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487177 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487499 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487815 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.487944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.488124 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.488243 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.488443 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.488569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.489374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.489610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.489786 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.489939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.490065 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.490219 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.490351 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.490539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.490668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.490857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.491175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.491410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.491531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.491807 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.491936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.492311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.492525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.492712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.492844 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.492999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.492999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.493347 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.493458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.493577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.493694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.493806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.493983 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.494148 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.494694 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.494828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.494828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.495156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.495286 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.495490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.495980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.496097 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.496260 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.496407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.496534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.496684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.496809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497187 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.497880 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498151 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498270 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498558 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498706 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.498891 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.499140 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.499260 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.499480 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.499778 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.500158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.500565 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.500706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.500939 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.501079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.501289 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.501449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.501605 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.501732 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.501950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.502084 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.502257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.502464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.502719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.502847 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503683 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503801 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.503922 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.504068 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.504193 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.504311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.504458 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506537 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506658 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.506912 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507060 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507176 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507287 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507506 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507630 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.507861 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508017 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508135 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508258 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508689 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.508843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.509006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.509174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.509302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.509440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 04:18:57.509559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.509772 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.510087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.510396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.510716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.511028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.511341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.511658 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.511962 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.512273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.512730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.512999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.513461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.513635 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.513952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.514281 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.514598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.514914 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.515383 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.515673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.516211 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.516477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.516802 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.517173 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.517511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.517825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.518136 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.518446 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.518774 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.519090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.519407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.519724 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.520177 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.520858 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.521005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.521285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.521603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.521918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.522233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.522627 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.522873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.523216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.523574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.523855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.524176 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.524496 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.525035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.525166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.525620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.526046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.526046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.526515 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.526718 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.526999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.527427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.528378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.528378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.528378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.528682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.529036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.529366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.529716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.530009 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.530323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.530660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.531009 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.531338 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.531666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.531979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.532295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.532596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.532950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.533317 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.533773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.534019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.534258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.534498 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.537099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.538844 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.538844 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.538844 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.538844 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.538844 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.539657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.539657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.539657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.540080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.540233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.540487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.540820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.541168 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.541484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.541817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.542126 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.542438 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.542752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.543199 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.543392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.543769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.544022 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.544328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.544659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.545010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.545365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.545872 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.546327 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.546546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.546971 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.547238 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.547479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:18:57.547728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 04:18:57.571761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_db.sqlalchemy.engines [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.600026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.context [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5(cell1) {{(pid=116304) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 04:18:57.604371 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:18:57.606067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:18:57.606835 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:18:57.608769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:18:57.620485 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.621877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.636595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.context [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5(cell1) {{(pid=116305) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 04:18:57.640832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:18:57.642460 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:18:57.643267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:18:57.645302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:18:57.656423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_db.sqlalchemy.engines [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.657526 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_db.sqlalchemy.engines [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.784736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:57.817501 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_db.sqlalchemy.engines [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:18:58.118826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:18:58.125634 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:18:58.145450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: WARNING keystonemiddleware.auth_token [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:18:58.152551 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: WARNING keystonemiddleware.auth_token [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:18:58.482956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:18:58.488104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-b9a750b1-c2d2-45a6-ab1d-f5984ac8767e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:18:58.494549 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56500c6a39c0 pid: 116304 (default app) Feb 15 04:18:58.496311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: WARNING keystonemiddleware.auth_token [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 04:18:58.501828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: WARNING keystonemiddleware.auth_token [None req-356745e1-cbc9-4150-85a8-39f510c878f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 04:18:58.507994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56500c6a39c0 pid: 116305 (default app) Feb 15 04:19:36.817507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-371084803", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "a909d0e6-c4b3-462a-b863-e1bf37a7bf54"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:19:37.231535 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-355d28cb-e41b-49a6-ae24-54bb36ab3399 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Action: 'create', calling method: .version_select at 0x7fc5d7c4cca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1774163224", "metadata": {"Type": "work"}}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:19:37.990008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] validate_networks() for [('a909d0e6-c4b3-462a-b863-e1bf37a7bf54', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:19:39.902141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-355d28cb-e41b-49a6-ae24-54bb36ab3399 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.730302 Feb 15 04:19:39.903849 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Feb 15 04:19:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3734 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 15 04:19:39.981473 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:19:39.982067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:19:39.982368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:19:39.982949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:19:39.983534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:19:40.013257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:40.014860 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:40.016350 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:40.018456 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:40.126399 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:19:40.140925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for user a2f544b022f84fb291d0794dca05788d and project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:19:40.180176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:19:40.187463 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:19:40.230183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-999674253", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "bfb96b13-817b-4246-b547-422f8cfd6b4a"}]}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:19:40.409699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8a0c2b05-420f-4184-9b51-8ef1f753e955 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.274471 Feb 15 04:19:40.413020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 5286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:19:40.429337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ba959bb5-3c45-4239-acf4-331f3d355abc tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Calling method '.version_select at 0x7fc5d723b5e0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:40.535137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] validate_networks() for [('bfb96b13-817b-4246-b547-422f8cfd6b4a', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:19:40.675617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ba959bb5-3c45-4239-acf4-331f3d355abc tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9" status: 200 len: 353 microversion: 2.1 time: 0.260696 Feb 15 04:19:40.681648 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:19:40 2022] GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9 => generated 353 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:19:40.694507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e36f65fa-b5d6-410a-adb8-c2e968297a56 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:40.698953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e36f65fa-b5d6-410a-adb8-c2e968297a56 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:41.003151 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e36f65fa-b5d6-410a-adb8-c2e968297a56 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:41.042205 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e36f65fa-b5d6-410a-adb8-c2e968297a56 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1217 microversion: 2.1 time: 0.359001 Feb 15 04:19:41.043071 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:40 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1217 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:41.688835 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5fa1124f-4d73-49c4-bb46-e9517615a6f2 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Calling method '.version_select at 0x7fc5d69cc9d0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:41.779229 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5fa1124f-4d73-49c4-bb46-e9517615a6f2 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9" status: 200 len: 354 microversion: 2.1 time: 0.094478 Feb 15 04:19:41.787479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:19:41 2022] GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:19:41.793557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0c2f6838-b52f-4c88-84bb-b38ed0aacef5 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Calling method '.version_select at 0x7fc5d69ccdc0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:41.901371 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0c2f6838-b52f-4c88-84bb-b38ed0aacef5 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9" status: 200 len: 354 microversion: 2.1 time: 0.112557 Feb 15 04:19:41.902096 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 5/6] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:19:41 2022] GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:19:41.919235 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-acd8abba-86ad-4c72-9b08-bde0e2c9176f tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Calling method '.version_select at 0x7fc5d69e1b80>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:42.064231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-acd8abba-86ad-4c72-9b08-bde0e2c9176f tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9" status: 202 len: 0 microversion: 2.1 time: 0.148067 Feb 15 04:19:42.068806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:19:41 2022] DELETE /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 04:19:42.073959 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-abbfabb1-7782-4361-a9d3-a06cbe675a0a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:42.074895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-abbfabb1-7782-4361-a9d3-a06cbe675a0a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:42.164734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-abbfabb1-7782-4361-a9d3-a06cbe675a0a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:42.174496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-abbfabb1-7782-4361-a9d3-a06cbe675a0a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1217 microversion: 2.1 time: 0.104174 Feb 15 04:19:42.184946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:42 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:42.184946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2a1e9aa7-a60a-4c2d-89b0-e23e48412ed7 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Calling method '.version_select at 0x7fc5d6a354c0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:42.260800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2a1e9aa7-a60a-4c2d-89b0-e23e48412ed7 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9" status: 200 len: 353 microversion: 2.1 time: 0.081824 Feb 15 04:19:42.261589 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:19:42 2022] GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:19:42.576064 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:19:42.576634 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:19:42.577072 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:19:42.577489 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:19:42.577908 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:19:42.607359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:42.608171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:42.610584 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:42.611744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:42.682364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Getting quotas for project 9ea72854422249cdb2433b90e5aa1252. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:19:42.713888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Getting quotas for user 2bc8a6f3334b4cb6bacb2757007578b1 and project 9ea72854422249cdb2433b90e5aa1252. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:19:42.734095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:19:42.737765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:19:42.905632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-502ce9ea-4dc5-42d3-854b-e7793063f73a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.000249 Feb 15 04:19:42.922540 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 2/10] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:19:42.929676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-10979ad0-fd75-4660-9d9f-6e7e1eae0c13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:42.931387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-10979ad0-fd75-4660-9d9f-6e7e1eae0c13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:43.127181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-10979ad0-fd75-4660-9d9f-6e7e1eae0c13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:43.146097 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-10979ad0-fd75-4660-9d9f-6e7e1eae0c13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1214 microversion: 2.1 time: 0.220596 Feb 15 04:19:43.148823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 9/11] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:42 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:43.195695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:43.196827 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:43.272876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:43.273382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:43.276359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ae142460-9c4a-467c-998c-01df8ca522f3 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Calling method '.version_select at 0x7fc5d69ccca0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:43.277191 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:43.281782 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:43.355433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-ae142460-9c4a-467c-998c-01df8ca522f3 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] HTTP exception thrown: Volume fb884f7b-e770-4d6c-b898-2081aa7e2cd9 could not be found. Feb 15 04:19:43.356687 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ae142460-9c4a-467c-998c-01df8ca522f3 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] Returning 404 to user: Volume fb884f7b-e770-4d6c-b898-2081aa7e2cd9 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:19:43.357606 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ae142460-9c4a-467c-998c-01df8ca522f3 tempest-VolumesGetTestJSON-81359330 tempest-VolumesGetTestJSON-81359330-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9" status: 404 len: 109 microversion: 2.1 time: 0.087861 Feb 15 04:19:43.358459 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 10/12] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:19:43 2022] GET /compute/v2.1/os-volumes/fb884f7b-e770-4d6c-b898-2081aa7e2cd9 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:19:43.585516 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:43.606458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6156f5cb-9268-4c65-b5be-e525b8c45eca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1269 microversion: 2.1 time: 0.416099 Feb 15 04:19:43.607951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 3/13] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:43 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1269 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:44.173101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:44.195233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:44.257635 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:44.258247 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:44.264052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:44.264475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:44.625584 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:44.629099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:44.642403 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:44.644349 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:44.650113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:44.650839 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:45.023915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:45.031817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:45.041701 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-db0e6bd9-4a23-44b7-90c5-08a41f4d4f08 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1275 microversion: 2.1 time: 0.419936 Feb 15 04:19:45.051423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 4/14] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:44 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1275 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:45.072783 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-64461225-99fb-4abb-9d1c-191ac1837fc7 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1210 microversion: 2.1 time: 0.910774 Feb 15 04:19:45.080930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 11/15] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:44 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1210 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:46.074060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:46.074985 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:46.090398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:46.099032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:46.102668 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:46.105447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:46.107941 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:46.108849 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:46.143218 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:46.144328 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:46.145325 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:46.145661 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:46.373671 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:46.386420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ae255b58-c732-4c80-b285-94068bd54180 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1272 microversion: 2.1 time: 0.286292 Feb 15 04:19:46.387258 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 12/16] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:46 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:46.666892 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:46.749572 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7cf1d215-d596-4002-b1af-1aab37566e7f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1275 microversion: 2.1 time: 0.675488 Feb 15 04:19:46.752136 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 5/17] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:46 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1275 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:47.408578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:47.411434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:47.450398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:47.456214 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:47.462075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:47.463252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:47.649981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:47.658830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1bb165b4-6be0-459f-ad8c-8e169f839717 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1272 microversion: 2.1 time: 0.258518 Feb 15 04:19:47.673123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:47 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:19:47.784848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:47.787466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:47.842787 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:47.853799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:47.859680 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:47.864709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:48.679880 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:48.680751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:48.694875 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:48.696273 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:48.700082 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:48.700960 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:48.883116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:48.905241 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-91efe1a9-7c89-4fe5-b17b-4ed7034b8157 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1272 microversion: 2.1 time: 0.230415 Feb 15 04:19:48.934101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 14/19] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:48 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:49.937907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:49.939076 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:49.984109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:49.985335 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:49.987156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:50.003759 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:50.953828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:50.982302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7d521b2b-7e7f-4426-b306-5559043e83c5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 3.205996 Feb 15 04:19:50.999631 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 6/20] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:47 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 3217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:51.040609 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:51.098769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-90518a6c-36d3-4c16-8e92-cb5659b1ff35 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1272 microversion: 2.1 time: 1.161282 Feb 15 04:19:51.102582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 15/21] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:49 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1272 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:19:52.008864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:52.009566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:52.022710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:52.023613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:52.028031 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:52.028563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:52.119733 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:52.120443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:52.135160 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:52.135900 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:52.136937 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:52.139960 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:52.763379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:52.773361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c9c0cb23-45a2-467c-9e02-388dc2ba686b tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 0.657497 Feb 15 04:19:52.777375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 16/22] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:52 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:53.802087 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:53.806931 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:53.843740 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:53.847115 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:53.850789 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:53.851683 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:54.583773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:54.634617 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5baa076b-ba15-4713-8919-9199a8b49e4a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 2.631133 Feb 15 04:19:54.635559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 7/23] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:52 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:54.873394 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:54.885581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a1fbf511-33b9-463e-ab16-08565c80295a tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.096469 Feb 15 04:19:54.887545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 17/24] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:53 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:55.120911 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-f4d6dd87-00f8-4762-bcfa-b8fc6dc7e638 req-afab5ebc-cfdd-4d74-93c7-fde4255b8519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf", "tag": "e5000b8c-e731-4109-b8ae-a57706444763"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:19:55.134498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:19:55.134498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:19:55.160951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-f4d6dd87-00f8-4762-bcfa-b8fc6dc7e638 req-afab5ebc-cfdd-4d74-93c7-fde4255b8519 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.161862 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-f4d6dd87-00f8-4762-bcfa-b8fc6dc7e638 req-afab5ebc-cfdd-4d74-93c7-fde4255b8519 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:55.195057 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-f4d6dd87-00f8-4762-bcfa-b8fc6dc7e638 req-afab5ebc-cfdd-4d74-93c7-fde4255b8519 service nova] Creating event network-changed:e5000b8c-e731-4109-b8ae-a57706444763 for instance f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf on hv-cinder-81610 Feb 15 04:19:55.197131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-f4d6dd87-00f8-4762-bcfa-b8fc6dc7e638 req-afab5ebc-cfdd-4d74-93c7-fde4255b8519 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 15 04:19:55.199853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.200864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:55.202255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.202952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:55.216392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.compute.rpcapi [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 15 04:19:55.217990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] Releasing lock "compute-rpcapi-router" {{(pid=116305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 15 04:19:55.275649 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8deae46b-ee7b-4849-965e-80969a2d8efc None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.626730 Feb 15 04:19:55.276855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 8/25] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:19:55.658631 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:55.660016 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:55.697326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.705340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:55.716980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.717643 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:55.915283 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:55.916168 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:55.938256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.938785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:55.939784 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:55.940992 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:57.464746 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:57.478133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ce215983-f9a3-4224-ae83-6f697e0f8e24 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 1.825292 Feb 15 04:19:57.479267 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 18/26] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:55 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:57.697916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:57.716267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-20a46b47-a9fc-42e5-928e-8c305ebd76e2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.806060 Feb 15 04:19:57.739609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 9/27] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:55 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:19:57.981595 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-150a942e-eb2e-4c7f-b38d-043d700e20c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'create', calling method: .version_select at 0x7fc5d6923ca0>, body: {"keypair": {"name": "tempest-keypair-2090852241"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:19:58.070853 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-150a942e-eb2e-4c7f-b38d-043d700e20c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:19:58.088859 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-150a942e-eb2e-4c7f-b38d-043d700e20c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for user 246b8f1d109749f3a8cf3da973aacaac and project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:19:58.510447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:58.512424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:58.538722 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:58.539098 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:58.540072 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:58.540515 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:58.709596 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-150a942e-eb2e-4c7f-b38d-043d700e20c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:19:58.725981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-150a942e-eb2e-4c7f-b38d-043d700e20c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for user 246b8f1d109749f3a8cf3da973aacaac and project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:19:58.770338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-150a942e-eb2e-4c7f-b38d-043d700e20c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.287921 Feb 15 04:19:58.772824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 19/28] 10.222.0.45 () {62 vars in 1198 bytes} [Tue Feb 15 04:19:57 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1293 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 15 04:19:58.788199 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:19:58.790042 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:19:58.820431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:58.823583 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:58.824612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:19:58.825215 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:19:59.894400 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:19:59.907872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ae718640-02d0-4d15-a071-9c1ad0d3e003 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.132423 Feb 15 04:19:59.910199 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 20/29] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:58 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:19:59.991711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:00.047742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8ed71dda-8012-4e0d-81fb-5a4788136e66 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 1.534060 Feb 15 04:20:00.053946 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 10/30] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:19:58 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:00.617354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-63c92f7c-5656-4153-b38a-f9a0bd749ba8 req-64de18a5-507b-4e72-bfba-a27ed4f9abfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ec6e38-42b9-43b6-9bb6-fc72a05b2607", "tag": "69f21ab9-d078-4316-b53b-b12b447aebd4"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:00.620219 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:00.620219 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:00.634426 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-63c92f7c-5656-4153-b38a-f9a0bd749ba8 req-64de18a5-507b-4e72-bfba-a27ed4f9abfe service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:00.635382 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-63c92f7c-5656-4153-b38a-f9a0bd749ba8 req-64de18a5-507b-4e72-bfba-a27ed4f9abfe service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:00.674246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-63c92f7c-5656-4153-b38a-f9a0bd749ba8 req-64de18a5-507b-4e72-bfba-a27ed4f9abfe service nova] Creating event network-changed:69f21ab9-d078-4316-b53b-b12b447aebd4 for instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 on hv-cinder-81610 Feb 15 04:20:00.675874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-63c92f7c-5656-4153-b38a-f9a0bd749ba8 req-64de18a5-507b-4e72-bfba-a27ed4f9abfe service nova] Acquired lock "compute-rpcapi-router" {{(pid=116304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 15 04:20:00.677533 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:00.678405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:00.679492 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:00.680159 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:00.695834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.compute.rpcapi [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 15 04:20:00.697252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] Releasing lock "compute-rpcapi-router" {{(pid=116304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 15 04:20:00.724780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-01dcad7b-e64a-4035-ba66-92bc07d7560d None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315008 Feb 15 04:20:00.725683 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 21/31] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:00.945712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:00.946273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:00.988858 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:00.989673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:01.025326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:01.031959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:01.119237 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:01.120797 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:01.136154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:01.138246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:01.162549 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:01.164390 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:02.378957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:02.417895 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fa96d520-3c33-41c9-b2f2-834c6a0abff8 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.475880 Feb 15 04:20:02.428542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 11/32] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:00 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:02.956259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d321d230-ec9c-4bf0-8aa2-d0b609b962cb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: .version_select at 0x7fc5d68ffe50>, body: {"keypair": {"name": "tempest-keypair-884644280"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:03.028461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-d321d230-ec9c-4bf0-8aa2-d0b609b962cb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:03.038623 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-d321d230-ec9c-4bf0-8aa2-d0b609b962cb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for user 6ae6b80b4cb946208c461caebad57faa and project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:03.101679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:03.118966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5806c6b4-3c2d-49dc-a1d4-c2c51c4d2787 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 2.017545 Feb 15 04:20:03.119641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 22/33] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:01 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:03.442874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:03.444553 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:03.463998 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:03.467167 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:03.468881 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:03.470659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:03.911836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-d321d230-ec9c-4bf0-8aa2-d0b609b962cb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:03.927196 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-d321d230-ec9c-4bf0-8aa2-d0b609b962cb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for user 6ae6b80b4cb946208c461caebad57faa and project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:03.985334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d321d230-ec9c-4bf0-8aa2-d0b609b962cb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.555033 Feb 15 04:20:03.993088 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 12/34] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Feb 15 04:20:02 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:04.136933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:04.138051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:04.152479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:04.153484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:04.161795 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:04.165933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:04.764464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:04.780385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-079b5df1-6d93-480e-a4d3-e2121ee51b71 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.344474 Feb 15 04:20:04.795896 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 23/35] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:03 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:05.584995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:05.595644 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c417e2dc-f818-47ef-be51-f38ad7a34618 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 1.462554 Feb 15 04:20:05.603562 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 13/36] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:04 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:05.802725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:05.803685 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:05.822380 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:05.823125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:05.824127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:05.824720 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:06.627975 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:06.629053 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:06.643474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:06.644224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:06.645741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:06.646459 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:06.851110 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:06.859553 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-edb38d14-0875-4982-b43a-88babda74311 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.063516 Feb 15 04:20:06.860170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 24/37] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:05 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:07.280049 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:07.324651 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f6f4b5d0-0bca-428d-9a51-ed5c87efb420 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 0.700839 Feb 15 04:20:07.327246 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 14/38] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:06 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:07.880864 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:07.883057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:07.896811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:07.897746 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:07.899285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:07.899967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:08.345427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:08.346993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:08.368566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:08.369779 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:08.371460 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:08.372517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:08.834203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:08.843075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-96914f26-c3c6-4055-9418-8a35e7a68053 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 0.968307 Feb 15 04:20:08.847071 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 25/39] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:07 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:09.133506 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1300347437", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:09.198999 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] validate_networks() for [('ee659080-78cf-4efd-be3b-466b39ec5040', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:20:09.233576 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:09.245346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-97777718-1df4-4206-a79c-df88129c6899 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 0.903533 Feb 15 04:20:09.246576 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 15/40] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:08 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:09.255049 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1142158129", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0c3e2a8-7b6d-47b3-b743-56e894a4b50d"}], "security_groups": [{"name": "tempest-securitygroup--842597418"}], "key_name": "tempest-keypair-2090852241", "user_data": "}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:09.605666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] validate_networks() for [('f0c3e2a8-7b6d-47b3-b743-56e894a4b50d', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:20:10.295053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:20:10.296439 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:20:10.297158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:20:10.297722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:20:10.298890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:20:10.315980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:10.316658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:10.317750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:10.318316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:10.344688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Getting quotas for project f8bc531651b748a791dbbbc11ee10adb. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:10.351058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Getting quotas for user 0ec544bab4b94d5e95eaf793afc0138c and project f8bc531651b748a791dbbbc11ee10adb. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:10.375310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:20:10.380610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:20:10.454170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7e0929c8-27af-490d-9da0-d5fb5576f622 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.603785 Feb 15 04:20:10.456040 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 26/41] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:20:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:20:10.463136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:10.464002 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:10.473739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:10.474445 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:10.475479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:10.476103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:10.742359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:10.777751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4c2a1a0f-6638-4618-b407-722d56a474e1 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 0.319521 Feb 15 04:20:10.794024 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 27/42] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:10 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:10.806503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:10.808494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:10.822634 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:10.824957 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:10.827518 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:10.829137 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:11.122059 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:11.133714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-57edf873-125c-4806-bd44-141f3e75857e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 0.337404 Feb 15 04:20:11.134545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 28/43] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:10 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:11.140886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-332a8509-296d-4fc0-9c0a-d9dd6dd882ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:11.141983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-332a8509-296d-4fc0-9c0a-d9dd6dd882ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:11.224406 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-332a8509-296d-4fc0-9c0a-d9dd6dd882ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:11.235452 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-332a8509-296d-4fc0-9c0a-d9dd6dd882ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1222 microversion: 2.1 time: 0.099359 Feb 15 04:20:11.241631 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 29/44] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:11 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:11.551759 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-444963913", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:11.719104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] validate_networks() for [('ee659080-78cf-4efd-be3b-466b39ec5040', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:20:11.893633 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:20:11.895587 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:20:11.896708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:20:11.897780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:20:11.898776 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:20:11.945255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:11.946063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:11.947447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:11.948073 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:12.022488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:12.041337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for user 246b8f1d109749f3a8cf3da973aacaac and project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:12.092684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:20:12.106642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:20:12.369432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5bfd71f5-b89b-4f80-b575-c7d0b236d9fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.121088 Feb 15 04:20:12.372673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 16/45] 10.222.0.45 () {62 vars in 1187 bytes} [Tue Feb 15 04:20:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 15 04:20:12.392015 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:12.405612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:12.427661 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:12.428489 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:12.430454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:12.432734 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:13.317444 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:20:13.318537 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:20:13.319232 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:20:13.319871 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:20:13.320995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:20:13.378166 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:13.380622 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:13.386124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:13.391258 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:13.530923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Getting quotas for project f8bc531651b748a791dbbbc11ee10adb. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:13.549755 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Getting quotas for user 0ec544bab4b94d5e95eaf793afc0138c and project f8bc531651b748a791dbbbc11ee10adb. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:13.626281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:20:13.631515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:20:13.753654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:13.805454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c04b2d7c-f37a-43c5-aac5-260a845e51ac tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.423669 Feb 15 04:20:13.821814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 17/46] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:12 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:13.834702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:13.835333 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:13.848287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:13.850715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:13.853788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:13.854528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:13.859605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef3dbb93-dbca-4b1d-97bd-1df19233afe6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.311962 Feb 15 04:20:13.867198 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 30/47] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:20:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:20:13.872415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:13.894684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:13.925895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:13.929658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:13.932261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:13.936961 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:14.165540 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:14.207926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:14.220936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:14.234520 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea65a5ca-d4ab-42e0-bbaa-5306ccfd6059 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1278 microversion: 2.20 time: 0.365533 Feb 15 04:20:14.249009 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 31/48] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:13 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:14.299092 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-991742696", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c49ed967-4df2-4c03-a3f7-11bc631a5279"}], "security_groups": [{"name": "tempest-securitygroup--788363311"}], "key_name": "tempest-keypair-884644280", "user_data": "}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:14.653500 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] validate_networks() for [('c49ed967-4df2-4c03-a3f7-11bc631a5279', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:20:14.672526 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:14.682900 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5f42c9dc-de7a-4c11-ac1d-fb6e19dc3f72 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 0.859489 Feb 15 04:20:14.693445 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 18/49] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:13 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:14.708429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-485c09c9-1f4d-4aef-8666-f02c8a419010 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:14.722504 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-485c09c9-1f4d-4aef-8666-f02c8a419010 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:15.026240 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-485c09c9-1f4d-4aef-8666-f02c8a419010 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:15.053880 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-485c09c9-1f4d-4aef-8666-f02c8a419010 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1221 microversion: 2.1 time: 0.359215 Feb 15 04:20:15.062380 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 19/50] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:14 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1221 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:15.068583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:15.069255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:15.109622 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:15.110277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:15.111159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:15.112169 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:16.053074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:16.090439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-70c9cc46-b8fd-4474-b86d-9706781ad4ab tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.026436 Feb 15 04:20:16.097837 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 20/51] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:15 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:16.108077 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:16.109216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:16.117697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:16.118568 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:16.119662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:16.120310 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:16.247257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:16.263439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:16.268319 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:16.270471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-862a4462-07d7-4234-b22c-2f43139eded0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1340 microversion: 2.20 time: 0.170916 Feb 15 04:20:16.271666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 21/52] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:16 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1340 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:16.277497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:16.278393 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:16.286947 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:16.287762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:16.288995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:16.289680 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:16.997004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:20:16.998835 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:20:17.000118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:20:17.001536 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:20:17.003713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:20:17.017998 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:17.019629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:17.020856 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:17.021959 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:17.052457 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:17.058612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for user 6ae6b80b4cb946208c461caebad57faa and project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:17.077418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:20:17.081408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:20:17.176122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-41feeaa6-5c47-46de-986b-7acb60cbe7af tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.923332 Feb 15 04:20:17.176867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 32/53] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:20:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:20:17.188092 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:17.189148 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:17.197858 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:17.198783 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:17.199892 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:17.200621 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:17.302849 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:17.315386 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:17.323212 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6a069bd9-2556-46e4-8779-799065385283 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1279 microversion: 2.1 time: 0.138860 Feb 15 04:20:17.329034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 33/54] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:17 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:17.371394 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1c0ebe3e-68c5-40e4-9997-93ca77625dda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 1.097483 Feb 15 04:20:17.375969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 22/55] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:16 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:17.421496 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:17.428712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:17.459248 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:17.460472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:17.464873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:17.472233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:17.934401 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-39f4d4d4-72ad-4aa3-936e-3aeb99d810d7 req-2f97ecbc-2215-423a-a562-6d02c5e2bb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf", "name": "network-vif-plugged", "status": "completed", "tag": "e5000b8c-e731-4109-b8ae-a57706444763"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:17.973192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:17.973192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:18.026684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-39f4d4d4-72ad-4aa3-936e-3aeb99d810d7 req-2f97ecbc-2215-423a-a562-6d02c5e2bb03 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:18.027699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-39f4d4d4-72ad-4aa3-936e-3aeb99d810d7 req-2f97ecbc-2215-423a-a562-6d02c5e2bb03 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:18.071424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-39f4d4d4-72ad-4aa3-936e-3aeb99d810d7 req-2f97ecbc-2215-423a-a562-6d02c5e2bb03 service nova] Creating event network-vif-plugged:e5000b8c-e731-4109-b8ae-a57706444763 for instance f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf on hv-cinder-81610 Feb 15 04:20:18.085044 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-39f4d4d4-72ad-4aa3-936e-3aeb99d810d7 req-2f97ecbc-2215-423a-a562-6d02c5e2bb03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.754077 Feb 15 04:20:18.086734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 34/56] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:18.101027 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c1a2fb3b-c52d-4b44-b26b-20ca6a4765a7 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:18.102951 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c1a2fb3b-c52d-4b44-b26b-20ca6a4765a7 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:18.166095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:18.207730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0e62105c-e340-448b-8e78-fcc3315df8dd tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 0.825060 Feb 15 04:20:18.209332 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 23/57] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:17 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:18.221557 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:18.223376 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:18.277477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:18.282479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:18.293142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:18.294791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:18.707334 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c1a2fb3b-c52d-4b44-b26b-20ca6a4765a7 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:18.714707 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c1a2fb3b-c52d-4b44-b26b-20ca6a4765a7 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1236 microversion: 2.1 time: 0.625370 Feb 15 04:20:18.725672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 35/58] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:18 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1236 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:18.730427 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:18.731045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:18.763172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:18.763654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:18.764654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:18.764874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:19.219803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:19.245876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:19.250984 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:19.256291 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-73fa2e7d-01de-4cf3-bd66-105cabe3eeec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 1.042651 Feb 15 04:20:19.277725 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 24/59] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:18 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:19.289810 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:19.291466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:19.306639 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:19.309810 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:19.311475 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:19.312124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:19.312646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:19.337154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e30dcff7-0283-4d92-b84d-c36444e90aaf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.609823 Feb 15 04:20:19.341215 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 36/60] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:18 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:19.365930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-c2319a1a-753c-40f9-b245-ce6f462ab474 req-169e4c9f-4bea-430d-8f93-e8e0edf8e37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca522ac8-8430-4ab4-aa43-9de561155e52", "tag": "3de6a7fb-53a5-40a9-af0f-ab012f0726c6"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:19.370905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:19.370905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:19.417258 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-c2319a1a-753c-40f9-b245-ce6f462ab474 req-169e4c9f-4bea-430d-8f93-e8e0edf8e37a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:19.418131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-c2319a1a-753c-40f9-b245-ce6f462ab474 req-169e4c9f-4bea-430d-8f93-e8e0edf8e37a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:19.448717 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-c2319a1a-753c-40f9-b245-ce6f462ab474 req-169e4c9f-4bea-430d-8f93-e8e0edf8e37a service nova] Creating event network-changed:3de6a7fb-53a5-40a9-af0f-ab012f0726c6 for instance ca522ac8-8430-4ab4-aa43-9de561155e52 on hv-cinder-81610 Feb 15 04:20:19.460360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-c2319a1a-753c-40f9-b245-ce6f462ab474 req-169e4c9f-4bea-430d-8f93-e8e0edf8e37a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115011 Feb 15 04:20:19.462012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 37/61] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:19.479939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:19.489366 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:19.507088 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:19.508643 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:19.510909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:19.511995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.038990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.048737 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1bb41553-4b8f-4bc1-9f15-88056c277697 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 0.769301 Feb 15 04:20:20.058827 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 25/62] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:19 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:20.064200 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:20.065483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:20.072985 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.073582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.074523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.075032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.211057 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.223146 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1168f59e-e3dc-4bfc-b0bf-c07b2efabab0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1294 microversion: 2.1 time: 0.162230 Feb 15 04:20:20.224249 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 26/63] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:20 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:20.232937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-c65a622e-307b-406b-b257-81dacb1ce8b3 req-f679c226-c4b0-4d41-b197-9d60785892c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ec6e38-42b9-43b6-9bb6-fc72a05b2607", "name": "network-vif-plugged", "status": "completed", "tag": "69f21ab9-d078-4316-b53b-b12b447aebd4"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:20.237637 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:20.237637 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:20.251042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-c65a622e-307b-406b-b257-81dacb1ce8b3 req-f679c226-c4b0-4d41-b197-9d60785892c9 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.252410 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-c65a622e-307b-406b-b257-81dacb1ce8b3 req-f679c226-c4b0-4d41-b197-9d60785892c9 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.273966 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-c65a622e-307b-406b-b257-81dacb1ce8b3 req-f679c226-c4b0-4d41-b197-9d60785892c9 service nova] Creating event network-vif-plugged:69f21ab9-d078-4316-b53b-b12b447aebd4 for instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 on hv-cinder-81610 Feb 15 04:20:20.282372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-c65a622e-307b-406b-b257-81dacb1ce8b3 req-f679c226-c4b0-4d41-b197-9d60785892c9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055743 Feb 15 04:20:20.283465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 27/64] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:20.299542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:20.300815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:20.312466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.313267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.314827 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.315607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.531794 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.541200 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.542848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.544013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d41dfa84-b335-48aa-9510-43d38ec70906 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.253227 Feb 15 04:20:20.544602 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 28/65] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:20 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:20.549505 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:20.550122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:20.556590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.557084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.558878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:20.559319 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:20.705846 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.766763 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d0f19b66-3acf-4c6b-9102-0acfd6f2bc13 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 1.302169 Feb 15 04:20:20.780585 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 38/66] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:19 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:20.884585 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:20.907187 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-696dd5a2-f89b-457e-867b-94b6ea319269 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.361236 Feb 15 04:20:20.909373 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 29/67] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:20 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:21.071823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:21.073960 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:21.088326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:21.090043 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:21.091762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:21.093135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:21.244769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:21.246107 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:21.264570 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:21.265326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:21.272825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:21.274334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:21.477347 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:21.504280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-892e8c31-aaf3-43f4-96a4-6e71784cc6f1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1294 microversion: 2.1 time: 0.264725 Feb 15 04:20:21.520938 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 30/68] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:21 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1294 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:21.571118 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:21.575804 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:21.607601 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:21.608916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:21.610999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:21.613323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.152692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.162606 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f5a6c7c8-ae28-43b6-bcf5-54ff1787d65a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 1.097861 Feb 15 04:20:22.173424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 39/69] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:21 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:22.179369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:22.180357 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:22.187378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:22.188508 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.190051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:22.191405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.264573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.275732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.277847 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.279365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5f3e71e8-f517-4bf5-8b5a-2555d3f23c8d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.717237 Feb 15 04:20:22.280782 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 31/70] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:21 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:20:22.286888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:22.288068 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:22.295627 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:22.296359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.297297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:22.297935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.740388 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.764327 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-43e1012b-6bd4-43ea-b60d-b2f0d971ca23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.481962 Feb 15 04:20:22.766258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 32/71] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:22 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:22.776143 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:22.777532 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:22.784684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.798371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:22.802346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.803439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:22.803934 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:22.808001 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a059eb69-5282-44f0-8f65-9e56f022e117 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1314 microversion: 2.1 time: 0.632030 Feb 15 04:20:22.823792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 40/72] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:22 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:22.945438 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:22.977323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1580328f-b8fd-4a3d-a35f-2cd6631fc7ec tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1294 microversion: 2.1 time: 0.203937 Feb 15 04:20:22.991681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 33/73] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:22 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:23.065653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-189c03f6-672f-4e95-85f7-54f2b3092362 req-9e577d83-3b65-41a1-acd7-3a65279723b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:23.070700 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:23.070700 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:23.087576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-189c03f6-672f-4e95-85f7-54f2b3092362 req-9e577d83-3b65-41a1-acd7-3a65279723b7 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.088484 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-189c03f6-672f-4e95-85f7-54f2b3092362 req-9e577d83-3b65-41a1-acd7-3a65279723b7 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:23.116480 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-189c03f6-672f-4e95-85f7-54f2b3092362 req-9e577d83-3b65-41a1-acd7-3a65279723b7 service nova] Creating event network-changed:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:20:23.131114 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-189c03f6-672f-4e95-85f7-54f2b3092362 req-9e577d83-3b65-41a1-acd7-3a65279723b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075022 Feb 15 04:20:23.133420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 41/74] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:20:23.183285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:23.184708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:23.212141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.213781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:23.217106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.218502 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:23.308851 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:23.309679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:23.317431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.318940 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:23.320279 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.323629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:23.625327 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:23.643019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-eff558a3-411b-4f4e-a11a-b09eaa42d152 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1317 microversion: 2.1 time: 0.464653 Feb 15 04:20:23.644534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 34/75] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:23 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:23.801732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:23.803251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:23.815890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.817587 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:23.824741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:23.827666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:24.186934 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:24.225786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:24.227354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:24.228515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-102269a6-9877-4696-bfb5-893fd677ed2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.923954 Feb 15 04:20:24.233622 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 42/76] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:23 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:24.240519 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:24.241569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:24.252019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:24.252620 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:24.257078 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:24.257535 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:24.368359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:24.379546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-aceaa806-df76-4f9e-a4c3-083bcdaff391 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.587423 Feb 15 04:20:24.380681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 35/77] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:23 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:24.393618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:24.397114 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:24.404965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:24.405420 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:24.407063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:24.407650 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:24.688428 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:24.706667 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-608aad22-1e0d-42a5-9522-db4e70ebe675 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.315392 Feb 15 04:20:24.708245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 36/78] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:24 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:24.717924 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:24.718952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:24.731880 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:24.732664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:24.734192 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:24.734988 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.016059 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:25.034417 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f344a7ad-870d-4cc8-aeca-c689f63c2202 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1508 microversion: 2.1 time: 0.323058 Feb 15 04:20:25.052067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 37/79] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:24 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:25.228742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-15d869ec-6a2d-44f6-90f6-12c076962f1c req-35932232-ec7e-4967-b0ff-8d2148933581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df009b7-64a5-4585-bde2-aa45e130fa97", "tag": "3749bf1d-7b7c-4d1e-b42c-d6d16599f7be"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:25.235423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:25.235423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:25.244841 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:25.253640 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-15d869ec-6a2d-44f6-90f6-12c076962f1c req-35932232-ec7e-4967-b0ff-8d2148933581 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.259512 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5d776aee-78a4-4bbc-9135-229695587a43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1500 microversion: 2.1 time: 1.022914 Feb 15 04:20:25.271098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 43/80] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:24 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1500 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:25.273788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-15d869ec-6a2d-44f6-90f6-12c076962f1c req-35932232-ec7e-4967-b0ff-8d2148933581 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.287614 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:25.289092 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:25.298083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.300376 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.301496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.302105 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.340002 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-15d869ec-6a2d-44f6-90f6-12c076962f1c req-35932232-ec7e-4967-b0ff-8d2148933581 service nova] Creating event network-changed:3749bf1d-7b7c-4d1e-b42c-d6d16599f7be for instance 8df009b7-64a5-4585-bde2-aa45e130fa97 on hv-cinder-81610 Feb 15 04:20:25.363374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-15d869ec-6a2d-44f6-90f6-12c076962f1c req-35932232-ec7e-4967-b0ff-8d2148933581 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143522 Feb 15 04:20:25.365205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 38/81] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:25.409836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:25.411653 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:25.426106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.427120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.428123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.429615 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.773549 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:25.805728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7866932b-62ef-4ca4-8e0c-99f6abd5a266 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.394256 Feb 15 04:20:25.816325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 39/82] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:25 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:25.833174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:25.833806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:25.848640 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.849135 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:25.849965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:25.850409 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:26.036169 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:26.055218 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:26.058903 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:26.061637 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3b4f701a-c4ad-4bb4-b916-5279448e7623 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.789235 Feb 15 04:20:26.068570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 44/83] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:25 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:26.166866 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:26.179127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d6920845-dc4a-4f1f-80ee-ebb2be3a5154 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.361172 Feb 15 04:20:26.180484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 40/84] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:25 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:26.844969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:26.847489 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:26.857337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:26.857904 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:26.858886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:26.859809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:27.094424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:27.101260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:27.102525 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:27.106042 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fd1af767-a553-4374-8482-5479b6208bb9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.268057 Feb 15 04:20:27.107434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 45/85] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:26 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:27.116776 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:27.117579 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:27.119007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:27.120030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:27.208544 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:27.209555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:27.218627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:27.219074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:27.225502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:27.225965 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:27.329901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:27.338944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:27.340535 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:27.341728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9c47c969-c9fc-428a-b0e7-1d9a690d6b97 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.248393 Feb 15 04:20:27.342304 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 41/86] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:27 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:20:27.422430 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-ddf76a0a-197a-44e2-9eb8-2396c3171cd3 req-5078c517-b847-43ae-b4ee-5bd0dcad865a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda24f72-ec24-4b2a-9eed-23dbe8b9706c", "tag": "cef1beba-9166-4527-9646-13388dc57d5b"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:27.425322 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:27.425322 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:27.437005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-ddf76a0a-197a-44e2-9eb8-2396c3171cd3 req-5078c517-b847-43ae-b4ee-5bd0dcad865a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:27.437811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-ddf76a0a-197a-44e2-9eb8-2396c3171cd3 req-5078c517-b847-43ae-b4ee-5bd0dcad865a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:27.457126 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-ddf76a0a-197a-44e2-9eb8-2396c3171cd3 req-5078c517-b847-43ae-b4ee-5bd0dcad865a service nova] Creating event network-changed:cef1beba-9166-4527-9646-13388dc57d5b for instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c on hv-cinder-81610 Feb 15 04:20:27.460092 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:27.464566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-ddf76a0a-197a-44e2-9eb8-2396c3171cd3 req-5078c517-b847-43ae-b4ee-5bd0dcad865a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045865 Feb 15 04:20:27.466018 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 42/87] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:20:27.468435 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a4eebc99-5174-4409-b4a5-8d3c41edec29 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.264482 Feb 15 04:20:27.473411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:27 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:28.128826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:28.129539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:28.136011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:28.136454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:28.137289 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:28.137720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:28.289059 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:28.297077 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8ea94a27-006c-48e7-950d-bc721f0ca0be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.172575 Feb 15 04:20:28.297754 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 43/89] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:28 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:28.372987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:28.373874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:28.380989 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:28.381355 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:28.382157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:28.382594 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:28.486742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:28.487329 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:28.493424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:28.493879 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:28.494695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:28.495136 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:28.535943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:28.549921 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:28.553054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:28.555175 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-253a653d-15dd-4f38-84f7-302238daa7ff tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.185988 Feb 15 04:20:28.556216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 47/90] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:28 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:28.685372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:28.694004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-50a6a1e2-20e9-4e7a-a161-b1ca3256134e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.210878 Feb 15 04:20:28.694603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 44/91] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:28 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:29.317119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:29.318026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:29.325724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:29.326391 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:29.327398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:29.328147 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:29.502570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:29.510948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8b10a2ed-7138-4e81-baec-4287304deb98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.200006 Feb 15 04:20:29.511734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 48/92] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:29 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:29.577498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:29.578190 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:29.585192 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:29.585662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:29.586471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:29.586909 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:29.716156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:29.717315 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:29.731363 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:29.732782 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:29.734680 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:29.736366 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:29.784150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:29.798928 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:29.802585 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:29.804920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-83db7427-7d58-4aa9-a03e-1e485fc02252 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.230969 Feb 15 04:20:29.805738 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 45/93] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:29 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:29.912121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:29.920065 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9701cb7c-023a-4bd3-9f96-6355ad6257ff tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.208514 Feb 15 04:20:29.920659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 49/94] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:29 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:30.534857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:30.536012 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:30.543785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:30.544727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:30.545747 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:30.546188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:30.809182 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:30.827574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-491c99e4-373c-4bb1-bb66-c8701c62ff20 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.300774 Feb 15 04:20:30.828948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:30.830143 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:30.831060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 46/95] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:30 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:30.859823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:30.862225 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:30.865578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:30.866910 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:30.947232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:30.948588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:30.964759 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:30.966277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:30.969183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:30.971973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:31.250109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:31.274720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a317cc50-0872-48f2-8676-db574d20a405 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.338878 Feb 15 04:20:31.277948 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 47/96] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:30 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:31.859353 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:31.860578 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:31.873907 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:31.875103 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:31.876833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:31.878127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:32.179933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:32.196428 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b7b813ef-5db8-4f59-9c70-45dcf50ef2cd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.342877 Feb 15 04:20:32.197941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 48/97] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:31 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:32.250682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:32.266751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:32.271183 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:32.273825 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7d7886c5-c2c9-4016-a908-2bf579002594 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 1.452272 Feb 15 04:20:32.275512 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 50/98] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:30 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:32.307432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:32.308221 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:32.321665 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:32.322346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:32.323618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:32.324539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:32.403995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f31dbb1c-28fb-46a6-8dad-896472016960"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:32.406226 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:32.418710 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:32.420006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:32.421877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:32.422581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:32.792404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:32.807436 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-63b6fb1e-b599-41b2-a512-a0145d720842 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.514700 Feb 15 04:20:32.824366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 49/99] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:32 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:32.833642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0735c5c-d196-4157-a9c1-4b0be0d5cc7c"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:32.836354 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:32.848743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:32.849882 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:32.851671 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:32.852614 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:33.225806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73a5f93b-7bfa-4f91-a874-fc21959aa8e9 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829709 Feb 15 04:20:33.227047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 51/100] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:20:32 2022] POST /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:33.234008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:33.235107 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:33.286721 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:33.292393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:33.295061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:33.301953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:33.630506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-60e79a9e-66be-46bb-b06a-1f6cf4886370 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "POST /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.802837 Feb 15 04:20:33.633280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 50/101] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:20:32 2022] POST /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:33.662797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:33.672756 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:33.694374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:33.694941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:33.698275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:33.700180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:33.715654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:33.739792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e8e5a384-5766-4e65-9db1-636ef2096afc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.511174 Feb 15 04:20:33.742045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 52/102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:33 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:33.831914 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:33.832918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:33.844308 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:33.848742 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:33.855310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:33.857295 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:34.061606 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:34.087966 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:34.097747 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:34.100007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f420129d-ed81-4b3d-9cab-32b5125cb9ee tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.465105 Feb 15 04:20:34.106131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 51/103] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:33 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:34.304692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:34.323787 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cf67d7e2-1fee-4979-8545-77c697513158 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.494891 Feb 15 04:20:34.325212 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 53/104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:33 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:34.776959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:34.777952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:34.791729 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:34.792357 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:34.794305 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:34.795645 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:35.135485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:35.136017 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:35.138176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:35.162956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-07cb3d50-ba02-403e-b5df-e138a176b816 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.390399 Feb 15 04:20:35.164356 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:35.164948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:35.165817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 52/105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:34 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:35.167101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:35.167546 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:35.357364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:35.365360 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:35.406951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:35.408606 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:35.426976 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:35.427866 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:35.466476 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:35.495881 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:35.502170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:35.514592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-599f8cd8-cc1d-4d15-b238-2f8cbf45532f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.381516 Feb 15 04:20:35.518918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 54/106] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:35 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:20:35.546921 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-eee42703-fb0e-416c-8d12-24b7ccfce9e6 req-e776da55-6b95-4757-ba7a-9b766a97845b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca522ac8-8430-4ab4-aa43-9de561155e52", "name": "network-vif-plugged", "status": "completed", "tag": "3de6a7fb-53a5-40a9-af0f-ab012f0726c6"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:35.550312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:35.550312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:35.563691 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-eee42703-fb0e-416c-8d12-24b7ccfce9e6 req-e776da55-6b95-4757-ba7a-9b766a97845b service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:35.565076 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-eee42703-fb0e-416c-8d12-24b7ccfce9e6 req-e776da55-6b95-4757-ba7a-9b766a97845b service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:35.622101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-eee42703-fb0e-416c-8d12-24b7ccfce9e6 req-e776da55-6b95-4757-ba7a-9b766a97845b service nova] Creating event network-vif-plugged:3de6a7fb-53a5-40a9-af0f-ab012f0726c6 for instance ca522ac8-8430-4ab4-aa43-9de561155e52 on hv-cinder-81610 Feb 15 04:20:35.643229 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-eee42703-fb0e-416c-8d12-24b7ccfce9e6 req-e776da55-6b95-4757-ba7a-9b766a97845b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117604 Feb 15 04:20:35.645179 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 55/107] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:35.754990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:35.766743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dba44c1b-6959-42a2-b95b-f7ab6a828888 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.419135 Feb 15 04:20:35.768091 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 53/108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:35 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:36.196327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:36.197589 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:36.208778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:36.210016 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:36.211726 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:36.212715 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:36.468867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:36.482401 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-27aebb20-9956-437f-9f7b-b2628ff31d9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.294651 Feb 15 04:20:36.482814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 56/109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:36 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:36.546418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:36.547947 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:36.557159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:36.558040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:36.560260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:36.561030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:36.796666 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:36.797523 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:36.811280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:36.815993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:36.817014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:36.817735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:37.059388 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:37.072604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bd6e2a08-4d58-48c6-b67f-517c0da990ac tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.280720 Feb 15 04:20:37.073743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 57/110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:36 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:37.133462 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:37.142951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:37.145427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:37.146820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-31f5bf50-8f36-4dc8-8c5f-baf64fafb3fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.604244 Feb 15 04:20:37.147569 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 54/111] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:36 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:37.506074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:37.507129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:37.517896 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:37.518649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:37.519792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:37.520507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:37.946750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:37.964865 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2f629cc0-e95a-43f5-8734-27a07a7843da tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.465202 Feb 15 04:20:37.966104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 58/112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:37 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:38.104461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:38.108482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:38.122038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:38.123002 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:38.124748 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:38.125603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:38.178237 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:38.178854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:38.186138 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:38.186928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:38.188292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:38.189012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:38.424736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:38.459365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f7361043-e4f3-40fa-81cd-5f7e39af9079 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.360933 Feb 15 04:20:38.462595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 55/113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:38 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:38.635407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:38.658045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:38.667302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:38.670241 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-48358354-0691-41aa-9f29-f83b52d441bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.497627 Feb 15 04:20:38.672079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 59/114] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:38 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:38.999834 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:39.001831 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:39.026236 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.027522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.029510 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.036345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.496885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:39.498657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:39.523768 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:39.530372 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.534767 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.540599 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.542773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.555403 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dd85b41f-7b7d-454b-9d78-165ca5a5300b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.562821 Feb 15 04:20:39.573170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 56/115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:38 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:39.665963 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-e5ea842a-8a1e-4fb4-933e-cf0af88e545b req-cf61706a-543b-4802-b570-8dbcf68a2604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df009b7-64a5-4585-bde2-aa45e130fa97", "name": "network-vif-plugged", "status": "completed", "tag": "3749bf1d-7b7c-4d1e-b42c-d6d16599f7be"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:39.669594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:39.669594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:39.708350 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-e5ea842a-8a1e-4fb4-933e-cf0af88e545b req-cf61706a-543b-4802-b570-8dbcf68a2604 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.713113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-e5ea842a-8a1e-4fb4-933e-cf0af88e545b req-cf61706a-543b-4802-b570-8dbcf68a2604 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.746497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-e5ea842a-8a1e-4fb4-933e-cf0af88e545b req-cf61706a-543b-4802-b570-8dbcf68a2604 service nova] Creating event network-vif-plugged:3749bf1d-7b7c-4d1e-b42c-d6d16599f7be for instance 8df009b7-64a5-4585-bde2-aa45e130fa97 on hv-cinder-81610 Feb 15 04:20:39.759346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-e5ea842a-8a1e-4fb4-933e-cf0af88e545b req-cf61706a-543b-4802-b570-8dbcf68a2604 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099236 Feb 15 04:20:39.761028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 57/116] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:20:39.777105 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:39.778885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:39.803026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.807060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.823840 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:39.830970 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:39.994083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:40.014169 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-75dc0e67-fc86-4200-8a35-4061cc91a60c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.523348 Feb 15 04:20:40.016739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 60/117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:39 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:40.205727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:40.225170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:40.226956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:40.232854 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5fc66d82-5f98-47b2-a1b2-12cda30d45f3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.466287 Feb 15 04:20:40.233549 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 58/118] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:39 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:40.581437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:40.582378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:40.594332 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:40.595978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:40.597559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:40.598510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:40.847878 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:40.856789 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3e1bb1f3-9ff5-4ca2-b797-3498f004f5c1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.280829 Feb 15 04:20:40.866847 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 61/119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:40 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:41.041830 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:41.042445 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:41.050425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.051244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:41.052122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.052649 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:41.246979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:41.254759 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:41.255226 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:41.268103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.268441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dd2771da-afa3-43a7-8406-a382122e0c87 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.226293 Feb 15 04:20:41.268634 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:41.272654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.273385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:41.281055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 59/120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:41 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:41.522791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:41.533253 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:41.535182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:41.536464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-66a3d810-c897-40ba-9782-7e0232b1c787 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.287548 Feb 15 04:20:41.541806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 62/121] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:41 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:41.817356 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-b454d57a-fd86-43d3-89c3-e073306b712e req-c7b7f0c5-9159-4bca-aca9-613b59ccf1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "name": "network-vif-plugged", "status": "completed", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:41.820621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:41.820621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:41.835946 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-b454d57a-fd86-43d3-89c3-e073306b712e req-c7b7f0c5-9159-4bca-aca9-613b59ccf1b6 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.837060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-b454d57a-fd86-43d3-89c3-e073306b712e req-c7b7f0c5-9159-4bca-aca9-613b59ccf1b6 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:41.865948 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-b454d57a-fd86-43d3-89c3-e073306b712e req-c7b7f0c5-9159-4bca-aca9-613b59ccf1b6 service nova] Creating event network-vif-plugged:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:20:41.885620 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:41.889365 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:41.894073 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-b454d57a-fd86-43d3-89c3-e073306b712e req-c7b7f0c5-9159-4bca-aca9-613b59ccf1b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083801 Feb 15 04:20:41.895207 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 60/122] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:41.917641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.918801 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:41.923613 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:41.928533 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:42.290147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:42.291413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:42.320715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:42.325486 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:42.327522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:42.328710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:42.727729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:42.743655 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dcc0cc4e-b100-47df-82f5-90b2546ac3f5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1321 microversion: 2.1 time: 0.870970 Feb 15 04:20:42.754569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 63/123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:41 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1321 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:42.759822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:42.760723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:42.770504 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:42.771262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:42.772502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:42.773488 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:42.818257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:42.827750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c938b4ca-0914-4d8a-8536-6958578c990b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.545230 Feb 15 04:20:42.838492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 61/124] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:42 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:43.271032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:43.286265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:43.288582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:43.292812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-19900bce-500e-4228-9414-e27aed5dc4a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.536784 Feb 15 04:20:43.297403 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 64/125] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:42 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:43.772998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:43.774198 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:43.786820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:43.787663 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:43.789427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:43.790175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:43.848582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:43.850029 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:43.864366 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:43.865223 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:43.867405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:43.868133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:44.146126 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:44.176517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-454ccaf5-2aef-49c6-8d49-2c028b30d4d9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1515 microversion: 2.1 time: 0.410439 Feb 15 04:20:44.177846 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 62/126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:43 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:44.185294 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-83f95ae4-71d0-410d-b4fd-d7552e3d8816 req-cb782d85-509a-4ed4-b237-e1703d17d41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda24f72-ec24-4b2a-9eed-23dbe8b9706c", "name": "network-vif-plugged", "status": "completed", "tag": "cef1beba-9166-4527-9646-13388dc57d5b"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:44.187467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:44.187467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:44.197571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-83f95ae4-71d0-410d-b4fd-d7552e3d8816 req-cb782d85-509a-4ed4-b237-e1703d17d41d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:44.199197 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-83f95ae4-71d0-410d-b4fd-d7552e3d8816 req-cb782d85-509a-4ed4-b237-e1703d17d41d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:44.227237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-83f95ae4-71d0-410d-b4fd-d7552e3d8816 req-cb782d85-509a-4ed4-b237-e1703d17d41d service nova] Creating event network-vif-plugged:cef1beba-9166-4527-9646-13388dc57d5b for instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c on hv-cinder-81610 Feb 15 04:20:44.238048 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-83f95ae4-71d0-410d-b4fd-d7552e3d8816 req-cb782d85-509a-4ed4-b237-e1703d17d41d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057085 Feb 15 04:20:44.239258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 63/127] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:44.243569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:44.253916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-986789154", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "a909d0e6-c4b3-462a-b863-e1bf37a7bf54"}]}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:44.287879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a4cffd03-75e3-413b-8012-547fdab5da94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.445265 Feb 15 04:20:44.293554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 65/128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:43 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:44.356566 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:44.358556 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:44.449146 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:44.449927 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:44.453323 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:44.457069 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:44.513261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] validate_networks() for [('a909d0e6-c4b3-462a-b863-e1bf37a7bf54', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:20:44.553397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lazy-loading 'flavor' on Instance uuid 8df009b7-64a5-4585-bde2-aa45e130fa97 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:20:44.855818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7aa8e7b5-22fa-4a07-b4b5-62dce52d7494 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97/action" status: 200 len: 32 microversion: 2.1 time: 0.533019 Feb 15 04:20:44.858476 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 66/129] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:20:44 2022] POST /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97/action => generated 32 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:20:44.870032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:44.875527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:44.951378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:44.962190 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:44.973473 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:44.976452 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:45.653757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:45.676354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:45.686568 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:45.690711 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9ca3cf1d-4afe-4457-b756-77386c9707b6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1407 microversion: 2.20 time: 0.829494 Feb 15 04:20:45.697172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 67/130] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:44 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1407 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:45.703172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:45.713185 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:45.726462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:45.726985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:45.727845 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:45.728389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:45.741862 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:20:45.742684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:20:45.743080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:20:45.743582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:20:45.744166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:20:45.763662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:45.764397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:45.767709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:45.769527 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:45.802544 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:20:45.808082 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for user a2f544b022f84fb291d0794dca05788d and project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:20:45.825483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:20:45.828496 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:20:45.898795 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-86d32ac3-01e7-422f-b377-a739589a3afe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.655075 Feb 15 04:20:45.906190 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 64/131] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:20:45.915835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:45.918068 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:45.945557 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:45.945766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:45.948299 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:45.951401 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:46.156371 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:46.168266 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bf1860d1-a665-480f-9716-0bd363d010f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.469717 Feb 15 04:20:46.169466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 68/132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:45 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:46.180438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d86bda8c-4646-4cd4-9bc0-6aa184bcb2d6 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:46.183189 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d86bda8c-4646-4cd4-9bc0-6aa184bcb2d6 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:46.552253 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:46.583563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4940f727-4beb-427e-bf5b-1b73aba90389 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1361 microversion: 2.1 time: 0.680151 Feb 15 04:20:46.585224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 65/133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:45 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1361 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:46.621950 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d86bda8c-4646-4cd4-9bc0-6aa184bcb2d6 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:46.639691 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d86bda8c-4646-4cd4-9bc0-6aa184bcb2d6 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1217 microversion: 2.1 time: 0.465608 Feb 15 04:20:46.640471 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 69/134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:46 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1217 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:46.719921 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:46.721291 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:46.729500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:46.730571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:46.731934 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:46.732529 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.084706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:47.093900 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:47.096342 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:47.098260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c29fe453-9950-4fc1-89b6-6f412704b498 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1598 microversion: 2.20 time: 0.382451 Feb 15 04:20:47.098852 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 66/135] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:20:46 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1598 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:20:47.135796 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:47.136916 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:47.162650 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.179194 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.181314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.186901 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.200171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:47.208822 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:47.225359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.226013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.229362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.232333 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.473417 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:47.487679 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d5272451-cc0d-4e40-8bba-07445336dd5c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.295223 Feb 15 04:20:47.488742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 67/136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:47 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:47.527469 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dc52e546-b2d0-4984-8583-6a0ef60c4bfe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.398409 Feb 15 04:20:47.542352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 70/137] 10.222.0.45 () {60 vars in 1315 bytes} [Tue Feb 15 04:20:47 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-interface => generated 284 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:20:47.602641 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:47.603539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:47.610115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.611346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.612359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.613005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.666586 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:47.667953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:47.689089 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.689944 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.691577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:47.693525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:47.839382 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:47.854834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9f6e166e-deda-4c2c-9cda-306fbcb6a79e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1269 microversion: 2.1 time: 0.196930 Feb 15 04:20:47.856624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 71/138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:47 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:48.102546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:48.131868 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5f8ef2e8-4687-4169-88bb-e7e6d00ff5a6 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1548 microversion: 2.1 time: 0.530789 Feb 15 04:20:48.132922 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 68/139] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:47 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1548 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:48.170302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:48.171194 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:48.213681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:48.214544 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:48.216300 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:48.224993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:48.507348 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:48.508056 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:48.518710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:48.522393 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:48.524883 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:48.525612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:48.684887 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3c6d95a2-c42d-42b7-b680-019937b36692 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.524820 Feb 15 04:20:48.685510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 72/140] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Feb 15 04:20:48 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-interface => generated 285 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:48.876538 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:48.877514 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:48.889877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:48.892413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:48.896500 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:48.898794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:49.060522 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:49.071200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d099b362-c01c-4df8-af16-88fd3bf83eaf tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1275 microversion: 2.1 time: 0.200191 Feb 15 04:20:49.072358 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 73/141] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:48 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:49.528843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:49.557411 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1ea89229-dc96-4a42-8fbe-7afe2d50d83c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 1.043725 Feb 15 04:20:49.570086 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 69/142] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:48 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:50.114461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:50.128222 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:50.172348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:50.174171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:50.176814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:50.178204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:50.529176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:50.542046 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-62cf67ad-dc01-49dc-a258-7d89dc7be96f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.446724 Feb 15 04:20:50.551347 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 74/143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:50 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:50.580984 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:50.582194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:50.594075 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:50.594914 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:50.596744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:50.598512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:50.855905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:50.860676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:50.881501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:50.881501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:50.881501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:50.881501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:50.937718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:20:51.089279 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-262463c5-f167-4c68-b96b-bdb6e8d5e7dc tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 204 len: 0 microversion: 2.1 time: 0.234714 Feb 15 04:20:51.090625 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 75/144] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:20:50 2022] DELETE /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:20:51.112500 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:51.114539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:51.131514 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.132675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.140513 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.157538 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.606278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:51.619885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a2608e9b-8329-48d7-9d86-9e561860dab6 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1552 microversion: 2.1 time: 0.521160 Feb 15 04:20:51.623631 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 76/145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:51 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1552 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:51.642126 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-dcfbf112-6055-4485-aed5-379484174ca5 req-8ce9fea4-f1e2-438c-a055-01be85ea2708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b17304-d7b8-4951-9026-adec2d4cc4d6", "tag": "b6600cc5-a977-447e-babc-502e1df4a937"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:51.644482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:51.644482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:51.662824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-dcfbf112-6055-4485-aed5-379484174ca5 req-8ce9fea4-f1e2-438c-a055-01be85ea2708 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.668135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-dcfbf112-6055-4485-aed5-379484174ca5 req-8ce9fea4-f1e2-438c-a055-01be85ea2708 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.702400 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-dcfbf112-6055-4485-aed5-379484174ca5 req-8ce9fea4-f1e2-438c-a055-01be85ea2708 service nova] Creating event network-changed:b6600cc5-a977-447e-babc-502e1df4a937 for instance 40b17304-d7b8-4951-9026-adec2d4cc4d6 on hv-cinder-81610 Feb 15 04:20:51.709930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-dcfbf112-6055-4485-aed5-379484174ca5 req-8ce9fea4-f1e2-438c-a055-01be85ea2708 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084812 Feb 15 04:20:51.711204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 77/146] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:51.729555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:51.738042 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:51.757967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.758423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.759629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.760108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.860958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:51.872089 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6ab0f040-f364-43e0-9473-be0d5add321f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 1.299061 Feb 15 04:20:51.872745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 70/147] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:50 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:51.888163 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:51.889046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:51.903802 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.906709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.907835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.909762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:51.958084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7071f6e4-ba3d-4a8d-a12a-0e2e267b5a99 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/ips" status: 200 len: 111 microversion: 2.20 time: 0.080561 Feb 15 04:20:51.962872 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 71/148] 10.222.0.45 () {60 vars in 1288 bytes} [Tue Feb 15 04:20:51 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/ips => generated 111 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:20:51.972205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-54f435f5-c8ae-46f7-9285-c11f1151553b req-44e7ec47-df87-4341-8f5e-2dabb1c8b982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:51.976035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:51.976035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:51.998542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-54f435f5-c8ae-46f7-9285-c11f1151553b req-44e7ec47-df87-4341-8f5e-2dabb1c8b982 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:51.999448 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-54f435f5-c8ae-46f7-9285-c11f1151553b req-44e7ec47-df87-4341-8f5e-2dabb1c8b982 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:52.026449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-54f435f5-c8ae-46f7-9285-c11f1151553b req-44e7ec47-df87-4341-8f5e-2dabb1c8b982 service nova] Creating event network-changed:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:20:52.047405 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-54f435f5-c8ae-46f7-9285-c11f1151553b req-44e7ec47-df87-4341-8f5e-2dabb1c8b982 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082973 Feb 15 04:20:52.049520 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 72/149] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:52.412461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:52.428038 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea8308c5-58f2-48d6-a9a2-953471c6c2ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.714756 Feb 15 04:20:52.431280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 78/150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:51 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:52.476432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:52.477375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:52.489036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:52.490746 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:52.494517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:52.495751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:52.575134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a753d4c6-e112-4b08-84ac-8c0ee6e47563 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/ips" status: 200 len: 107 microversion: 2.1 time: 0.102902 Feb 15 04:20:52.578970 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 73/151] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:20:52 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/ips => generated 107 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:52.650106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:52.652534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:52.678585 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:52.680190 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:52.682494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:52.685992 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:52.894298 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:52.897549 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:52.913053 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:52.914184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:52.916694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:52.917746 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:53.370861 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:53.386730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a52e4cfa-cad0-41b2-a564-3544c6169e17 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.497319 Feb 15 04:20:53.387358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 74/152] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:52 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:53.454878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:53.455897 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:53.474170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:53.475458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:53.476533 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:53.482193 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:53.582799 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:53.603543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-16241e69-3272-4cbb-a5b8-97e4d0defd4e tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1552 microversion: 2.1 time: 0.956429 Feb 15 04:20:53.604260 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 79/153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:52 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1552 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:53.773545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:53.786347 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8eb3a10e-985d-4aa6-bf82-3d6b3bda5f68 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.337095 Feb 15 04:20:53.789466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 75/154] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:53 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:54.096967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-33907a16-d042-4614-8d5e-a2cf42d1a835 req-6f96024c-5fe5-459e-8b6e-b41dd4504aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda24f72-ec24-4b2a-9eed-23dbe8b9706c", "tag": "cef1beba-9166-4527-9646-13388dc57d5b"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:54.098762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:54.098762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:20:54.115117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-33907a16-d042-4614-8d5e-a2cf42d1a835 req-6f96024c-5fe5-459e-8b6e-b41dd4504aec service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.115465 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-33907a16-d042-4614-8d5e-a2cf42d1a835 req-6f96024c-5fe5-459e-8b6e-b41dd4504aec service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:54.146738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-33907a16-d042-4614-8d5e-a2cf42d1a835 req-6f96024c-5fe5-459e-8b6e-b41dd4504aec service nova] Creating event network-changed:cef1beba-9166-4527-9646-13388dc57d5b for instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c on hv-cinder-81610 Feb 15 04:20:54.155818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-33907a16-d042-4614-8d5e-a2cf42d1a835 req-6f96024c-5fe5-459e-8b6e-b41dd4504aec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063792 Feb 15 04:20:54.157840 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 80/155] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:20:54.462701 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:54.467552 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:54.503112 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.503964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:54.512017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.513259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:54.622099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:54.623325 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:54.632362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.633122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:54.634232 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.634920 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:54.824096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:54.832985 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-55752f1c-0d36-4c15-9571-ef3bbdf2d437 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.406989 Feb 15 04:20:54.837013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 76/156] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:54 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:54.857027 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:54.858237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:54.883287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.884392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:54.885170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:54.885628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:55.115664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:55.127250 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3f864794-023e-442e-a72f-1a1f96cf46ad tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.291598 Feb 15 04:20:55.128277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 77/157] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:54 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:55.438336 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:55.461074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f028f137-7fc5-4740-b3ab-e2fccc18a93d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1552 microversion: 2.1 time: 0.843097 Feb 15 04:20:55.463859 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:54 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1552 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:55.859264 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:55.862205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:55.877764 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:55.878611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:55.880359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:55.881788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:56.147828 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:56.148458 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:56.160800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:56.161586 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:56.164478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:56.165234 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:56.169712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:56.208726 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b459f3ce-6cca-4150-b4cc-3adcb247368d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.357617 Feb 15 04:20:56.210464 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 78/159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:55 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:56.403030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-5067594a-1a5a-441e-bce8-5b81ce91459f req-17f5e7d0-975e-42fe-9038-98beb8312cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ec6e38-42b9-43b6-9bb6-fc72a05b2607", "name": "network-vif-deleted", "tag": "69f21ab9-d078-4316-b53b-b12b447aebd4"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:20:56.411161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:20:56.411161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:20:56.428352 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-5067594a-1a5a-441e-bce8-5b81ce91459f req-17f5e7d0-975e-42fe-9038-98beb8312cbc service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:56.430635 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-5067594a-1a5a-441e-bce8-5b81ce91459f req-17f5e7d0-975e-42fe-9038-98beb8312cbc service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:56.449750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-5067594a-1a5a-441e-bce8-5b81ce91459f req-17f5e7d0-975e-42fe-9038-98beb8312cbc service nova] Creating event network-vif-deleted:69f21ab9-d078-4316-b53b-b12b447aebd4 for instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 on hv-cinder-81610 Feb 15 04:20:56.458855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-5067594a-1a5a-441e-bce8-5b81ce91459f req-17f5e7d0-975e-42fe-9038-98beb8312cbc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068696 Feb 15 04:20:56.460085 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 79/160] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:20:56.492934 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:56.494467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:56.499002 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:56.508980 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:56.509821 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:56.511230 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:56.512425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:56.518474 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4880e51d-52bd-4ead-9309-20113c5aa4d2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.372529 Feb 15 04:20:56.519647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 82/161] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:56 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:56.602859 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8a6f3334b4cb6bacb2757007578b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea72854422249cdb2433b90e5aa1252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:56.614978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2f4c19af-e01e-4980-af18-e69d726e1dd2 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 200 len: 1345 microversion: 2.1 time: 0.130005 Feb 15 04:20:56.615556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 80/162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:56 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 1345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:57.239735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:57.240930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:57.251062 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.251780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.253252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.253978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.479414 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:57.491031 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6824a460-ed43-4190-9760-1a62ff6c5230 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.258672 Feb 15 04:20:57.501406 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 83/163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:57 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:57.546074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:57.548376 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:57.570866 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.571576 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.572820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.573451 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.635940 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:57.636706 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:57.649510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.650458 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.652266 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.653825 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.683296 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] HTTP exception thrown: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. Feb 15 04:20:57.684403 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Returning 404 to user: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:20:57.685985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e21b0ce7-0899-40d1-bb20-74c5d9373c43 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 404 len: 111 microversion: 2.1 time: 0.055635 Feb 15 04:20:57.687035 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 84/164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:57 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:20:57.801346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:57.812760 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d529732a-6d36-4865-9033-be5179877442 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.273209 Feb 15 04:20:57.814148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 81/165] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:57 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:57.847117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:57.848118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:57.854813 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.855261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.856053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:57.856491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:57.872440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] HTTP exception thrown: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. Feb 15 04:20:57.873375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Returning 404 to user: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:20:57.874164 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3af0ae38-5d91-4002-b663-290873e3204d tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031890 Feb 15 04:20:57.874715 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 85/166] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:20:57 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:20:58.509405 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:58.510261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:58.517877 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:58.518398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:58.519116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:58.519545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:58.737143 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:58.746386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-41f948a0-376b-4db4-a18e-74c55c46c84b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.241760 Feb 15 04:20:58.747833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 82/167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:58 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:20:58.832480 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:58.833392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:58.842286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:58.843061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:58.845189 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:58.845994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:59.047142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:20:59.057743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-91c40ea6-581c-4e96-8d97-fc66d58b1938 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.229682 Feb 15 04:20:59.059273 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 86/168] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:58 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:20:59.117492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:59.118175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:59.128833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:59.129656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:59.131129 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:59.131937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:59.158960 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] HTTP exception thrown: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. Feb 15 04:20:59.159637 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Returning 404 to user: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:20:59.160740 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bb18c46a-1d8d-4fcc-af97-a30c1ce58a97 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 404 len: 111 microversion: 2.1 time: 0.047115 Feb 15 04:20:59.161706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 83/169] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:20:59 2022] DELETE /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:20:59.170680 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:59.171565 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] [instance: e7ec6e38-42b9-43b6-9bb6-fc72a05b2607] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:59.178422 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:59.178989 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:59.179895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:59.180413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:59.200591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] HTTP exception thrown: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. Feb 15 04:20:59.201452 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] Returning 404 to user: Instance e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:20:59.202407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bba1ff36-f89d-4d57-85bb-98f173392668 tempest-DeleteServersTestJSON-1854689447 tempest-DeleteServersTestJSON-1854689447-project] 10.222.0.45 "GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607" status: 404 len: 111 microversion: 2.1 time: 0.035688 Feb 15 04:20:59.203086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 87/170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:59 2022] GET /compute/v2.1/servers/e7ec6e38-42b9-43b6-9bb6-fc72a05b2607 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:20:59.769884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:20:59.771039 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:20:59.784308 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:59.785161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:20:59.786583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:20:59.787371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:00.090884 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:00.092708 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:00.116057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:00.117520 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:00.119574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:00.119842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:00.121081 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:00.132204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0ba48bfa-2e1b-4e73-87a2-a03835a811d5 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.370346 Feb 15 04:21:00.132792 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 84/171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:20:59 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:00.359112 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:00.377327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b9790e18-25f5-43a1-a75e-e669190967df tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.294057 Feb 15 04:21:00.378672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 88/172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:00 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:01.170422 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:01.171472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:01.193540 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:01.194343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:01.195990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:01.196541 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:01.399228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:01.405091 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:01.405917 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:01.414385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:01.414846 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:01.415671 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:01.416127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:01.416717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7f76ee9f-417d-4de7-bea0-a7aedc323ee3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.259621 Feb 15 04:21:01.417801 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 85/173] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:01 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:01.594018 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:01.607390 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e066021c-e57e-4750-aa93-9d58df7620eb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.205695 Feb 15 04:21:01.608374 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 89/174] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:01 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:02.445550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:02.446981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:02.458009 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:02.458816 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:02.460106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:02.461033 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:02.640584 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:02.644375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:02.674203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:02.679584 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:02.682767 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:02.684376 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:02.740129 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:02.761594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a378b9fe-071a-4f8c-9b81-8247c7fc9551 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.321505 Feb 15 04:21:02.762460 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 86/175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:02 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:02.960061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:02.971301 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bc8524b2-08cb-4f24-b3f3-459c090f3100 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.338763 Feb 15 04:21:02.972134 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 90/176] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:02 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:03.209014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-e62e2263-fb58-4129-836b-e8dc84d094d1 req-3ed7e05a-def2-4148-8c2d-c81d818d228d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b17304-d7b8-4951-9026-adec2d4cc4d6", "name": "network-vif-plugged", "status": "completed", "tag": "b6600cc5-a977-447e-babc-502e1df4a937"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:03.212324 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:21:03.212324 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:21:03.226728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-e62e2263-fb58-4129-836b-e8dc84d094d1 req-3ed7e05a-def2-4148-8c2d-c81d818d228d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:03.227522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-e62e2263-fb58-4129-836b-e8dc84d094d1 req-3ed7e05a-def2-4148-8c2d-c81d818d228d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:03.245247 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-e62e2263-fb58-4129-836b-e8dc84d094d1 req-3ed7e05a-def2-4148-8c2d-c81d818d228d service nova] Creating event network-vif-plugged:b6600cc5-a977-447e-babc-502e1df4a937 for instance 40b17304-d7b8-4951-9026-adec2d4cc4d6 on hv-cinder-81610 Feb 15 04:21:03.251722 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-e62e2263-fb58-4129-836b-e8dc84d094d1 req-3ed7e05a-def2-4148-8c2d-c81d818d228d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049976 Feb 15 04:21:03.252771 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 87/177] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:03.785812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:03.786851 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:03.795503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:03.796129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:03.797081 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:03.798272 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:03.992954 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:03.994767 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:04.005763 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:04.007151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:04.008259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:04.009030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:04.079998 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:04.099067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-40a8bc66-28dd-45cf-9bc7-fcc5244dcf4f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.318851 Feb 15 04:21:04.101320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 91/178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:03 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:04.326067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:04.341979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-abb4ff64-210a-4316-9b81-732ba39320d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.355295 Feb 15 04:21:04.343428 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 88/179] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:03 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:05.118835 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:05.119475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:05.127216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:05.127694 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:05.128484 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:05.128941 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:05.289160 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:05.300261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a40cd5aa-09b9-4fb0-9dde-9b8697757fdc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.185064 Feb 15 04:21:05.301197 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 92/180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:05 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:05.362330 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:05.363060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:05.373252 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:05.373701 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:05.374511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:05.374975 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:05.553295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:05.565372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f25f5db9-2234-4662-9db0-8b43127bb42a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1317 microversion: 2.1 time: 0.208085 Feb 15 04:21:05.575019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 89/181] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:05 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:06.317769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:06.318672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:06.325762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:06.326218 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:06.327187 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:06.327614 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:06.514314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:06.533710 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d660e1f3-7698-4458-a674-f4d7c87e45fe tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.219823 Feb 15 04:21:06.534326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 93/182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:06 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:06.583221 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:06.584044 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:06.590546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:06.591187 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:06.591993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:06.592426 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:06.798987 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:06.806769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0450510d-6098-4f3e-9db5-baafc6933790 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1507 microversion: 2.1 time: 0.227949 Feb 15 04:21:06.807262 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 90/183] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:06 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:06.825257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f31dbb1c-28fb-46a6-8dad-896472016960"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:06.825502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:06.833361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:06.833816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:06.834615 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:06.835059 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:06.976336 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] HTTP exception thrown: Invalid volume: volume f31dbb1c-28fb-46a6-8dad-896472016960 is already attached to instances: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf Feb 15 04:21:06.977070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Returning 400 to user: Invalid volume: volume f31dbb1c-28fb-46a6-8dad-896472016960 is already attached to instances: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:21:06.977999 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cb5de3f8-aad3-4c12-8c25-ec26d1ba0362 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157756 Feb 15 04:21:06.978674 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 94/184] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:21:06 2022] POST /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:21:07.088197 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:07.088686 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:07.097338 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:07.098051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:07.099160 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:07.099920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:07.322106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lazy-loading 'services' on Instance uuid f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:21:07.533210 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2576fb15-2f8d-474f-baff-0ed7be752756 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments/f31dbb1c-28fb-46a6-8dad-896472016960" status: 202 len: 0 microversion: 2.1 time: 0.446414 Feb 15 04:21:07.533210 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 91/185] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:21:07 2022] DELETE /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments/f31dbb1c-28fb-46a6-8dad-896472016960 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:21:07.543838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:07.544877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:07.556550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:07.557291 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:07.561114 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:07.561654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:07.562511 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:07.563641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:07.581473 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:07.582217 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:07.591870 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:07.593232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:07.612791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a545d15d-2df4-4d3d-af76-64c9f90db956 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073424 Feb 15 04:21:07.613918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 95/186] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:07 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:07.782901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:07.796819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1248413d-a570-4284-a154-ec2e1d810e66 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.246270 Feb 15 04:21:07.798702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:07 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:08.627669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:08.629282 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:08.637284 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:08.637894 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:08.638821 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:08.639367 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:08.687273 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4947452d-61b9-401e-bb82-0d279eb82aba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058790 Feb 15 04:21:08.687273 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 96/188] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:08 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:08.815681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:08.816397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:08.823312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:08.823770 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:08.824589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:08.825080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:08.989504 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:08.997623 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-eda465a1-a08b-4bb2-a6b4-62d7b17439e9 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.186104 Feb 15 04:21:08.998596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 93/189] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:08 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:09.692281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:09.693487 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:09.701247 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:09.701904 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:09.704433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:09.705739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:09.759390 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9bfc3bff-f88b-4f66-8dae-88e58c9e314e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071452 Feb 15 04:21:09.760659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 97/190] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:09 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:10.017707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:10.018325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:10.025265 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:10.025720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:10.026551 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:10.026988 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:10.202236 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:10.210614 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8076be8a-7b96-4af1-b544-9b1807b6bf2e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.196760 Feb 15 04:21:10.211201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 94/191] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:10 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:10.773450 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:10.775107 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:10.784021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:10.784537 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:10.785764 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:10.786207 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:10.821291 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5fcb7674-5606-44dc-bdd5-fc42354394f8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 Feb 15 04:21:10.821877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 98/192] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:10 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:21:11.228224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:11.228881 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:11.236257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:11.236804 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:11.237732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:11.238166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:11.386713 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:11.394719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7d299103-4545-4edf-82da-de6b2bfd257b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.170327 Feb 15 04:21:11.395309 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 95/193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:11 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:11.834328 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:11.835243 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:11.842596 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:11.843089 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:11.844601 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:11.845116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:11.881970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-49e1b4b3-dc78-4ac9-bb31-5f347b400f57 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051322 Feb 15 04:21:11.884710 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 99/194] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:11 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:21:12.411678 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:12.412361 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:12.419626 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:12.420076 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:12.420857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:12.421319 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:12.572885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:12.582004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d66a6ba5-a5e5-40fe-aaed-f043020ce866 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.174230 Feb 15 04:21:12.582662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 96/195] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:12 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:12.903148 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:12.904177 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:12.911491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:12.911949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:12.912778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:12.913242 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:12.952187 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bdbc20a3-0bd3-4638-91cb-7320c15f607d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054943 Feb 15 04:21:12.957758 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 100/196] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:12 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:13.600805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:13.601927 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:13.615423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:13.616183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:13.617123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:13.617681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:13.789589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:13.801259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-862d6fb7-c7e2-4276-ab16-c745d027fa98 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.203679 Feb 15 04:21:13.801855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 97/197] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:13 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:13.965601 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:13.966581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:13.975109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:13.975563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:13.976375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:13.976822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:14.007616 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ebfa6576-56be-4c8b-a63d-4de6f1466c9e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045805 Feb 15 04:21:14.008461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 101/198] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:21:13 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:21:14.210607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201138881", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "a909d0e6-c4b3-462a-b863-e1bf37a7bf54"}]}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:14.332848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] validate_networks() for [('a909d0e6-c4b3-462a-b863-e1bf37a7bf54', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:21:14.825116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:14.825731 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:14.833819 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:14.834348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:14.835357 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:14.835788 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:14.915228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:21:14.916270 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:21:14.916744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:21:14.917379 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:21:14.917825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:21:14.930490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:14.930953 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:14.932438 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:14.933070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:14.959614 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:21:14.964367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for user a2f544b022f84fb291d0794dca05788d and project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:21:14.978944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:21:14.981364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:21:15.040071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-63a5d6cc-947c-4dd4-aaf4-f946dc4df789 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838739 Feb 15 04:21:15.049129 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 98/199] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 04:21:15.052109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:15.058948 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9e030148-aecb-4c60-a90b-b75f284d12c8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:15.059371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9e030148-aecb-4c60-a90b-b75f284d12c8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:15.064292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8c1c6dfe-af93-4149-ac19-c834b9e7765e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.242851 Feb 15 04:21:15.064930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 102/200] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:14 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:15.148478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9e030148-aecb-4c60-a90b-b75f284d12c8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:15.169994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9e030148-aecb-4c60-a90b-b75f284d12c8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1217 microversion: 2.1 time: 0.109802 Feb 15 04:21:15.169994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 99/201] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:15 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:16.085299 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:16.086423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:16.098111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:16.098833 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:16.100658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:16.101680 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:16.190208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:16.191113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:16.204062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:16.204564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:16.205620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:16.206059 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:16.297874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:16.308051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:16.314689 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-91119727-b85c-4890-8f86-1c75e7375213 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.233382 Feb 15 04:21:16.315895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 103/202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:16 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:16.317636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-14964f80-cc2a-45d3-af39-7b4179cb3769 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1221 microversion: 2.1 time: 0.131405 Feb 15 04:21:16.318341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 100/203] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:16 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:17.333331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:17.334531 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:17.342033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:17.342786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:17.343461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:17.345664 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:17.354357 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:17.355745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:17.367650 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:17.368369 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:17.369676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:17.370430 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:17.458050 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:17.466548 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fdb333c7-1018-4318-ac69-5191c78a6649 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1221 microversion: 2.1 time: 0.120844 Feb 15 04:21:17.467448 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 101/204] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:17 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:17.534646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:17.542539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-93a64fd6-5728-4f9e-a344-9de40277528c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.212795 Feb 15 04:21:17.543135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 104/205] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:17 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:18.493450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:18.494063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:18.501758 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:18.502341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:18.503338 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:18.503875 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:18.560315 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:18.560996 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:18.568397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:18.568838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:18.569682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:18.570118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:18.586869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:18.601127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ccb09adc-f7b9-49f2-97e2-681fe18612fe tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1269 microversion: 2.1 time: 0.110993 Feb 15 04:21:18.608485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 102/206] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:18 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:18.754114 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:18.763060 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-35941f0f-979c-4d83-81c6-72b4bdb4901e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.206381 Feb 15 04:21:18.764006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 105/207] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:18 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:19.622836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:19.623887 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:19.639609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:19.641842 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:19.644213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:19.645096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:19.786293 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:19.787530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:19.799054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:19.799767 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:19.801040 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:19.801776 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:19.890202 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:19.901008 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-291985bb-c741-484a-a673-6019bca551a3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.284900 Feb 15 04:21:19.901856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 103/208] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:19 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:20.173132 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:20.186018 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-60bef15c-81c5-4b6c-b3c1-32e682012802 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.407714 Feb 15 04:21:20.187692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 106/209] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:19 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:20.586925 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-78c80393-f6a6-486c-a598-58635bf6d64d req-9ddf580a-9839-4f53-8a0b-3b3f368b806b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a44514-834f-40e0-8a03-1f39942e705f", "tag": "8b743140-5b15-4189-a9ad-b671dd542c58"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:20.594441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:21:20.594441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:21:20.608695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-78c80393-f6a6-486c-a598-58635bf6d64d req-9ddf580a-9839-4f53-8a0b-3b3f368b806b service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:20.610780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-78c80393-f6a6-486c-a598-58635bf6d64d req-9ddf580a-9839-4f53-8a0b-3b3f368b806b service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:20.629791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-78c80393-f6a6-486c-a598-58635bf6d64d req-9ddf580a-9839-4f53-8a0b-3b3f368b806b service nova] Creating event network-changed:8b743140-5b15-4189-a9ad-b671dd542c58 for instance 65a44514-834f-40e0-8a03-1f39942e705f on hv-cinder-81610 Feb 15 04:21:20.635303 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-78c80393-f6a6-486c-a598-58635bf6d64d req-9ddf580a-9839-4f53-8a0b-3b3f368b806b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057472 Feb 15 04:21:20.635887 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 104/210] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:20.926723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:20.927400 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:20.934567 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:20.935017 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:20.936090 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:20.936529 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:21.206366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:21.207094 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:21.213867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:21.214386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:21.215202 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:21.215641 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:21.417711 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:21.426699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d81dc8ee-f390-4658-9c08-c5f8ddcb830c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.504694 Feb 15 04:21:21.429352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 107/211] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:20 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:21.478378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:21.490429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b22df3f2-9a7e-42cd-ae94-744b02ecbd45 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.289079 Feb 15 04:21:21.491646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 105/212] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:21 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:22.463823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:22.467779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:22.477392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:22.478166 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:22.479641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:22.480426 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:22.510301 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:22.511687 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:22.519592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:22.520396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:22.521478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:22.522151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:22.728712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:22.739004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-44e0d855-9d26-4dc8-a13d-8ba20e2fb231 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.282071 Feb 15 04:21:22.740133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 108/213] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:22 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:22.796824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:22.809273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-791035ff-ed06-43aa-baa0-70eb39f09529 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.303519 Feb 15 04:21:22.813781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 106/214] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:22 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:23.759485 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:23.760496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:23.768339 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:23.768817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:23.769687 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:23.770130 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:23.837669 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:23.838817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:23.851578 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:23.852384 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:23.853907 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:23.854716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:23.981916 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:23.998475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5f96cdf3-4bec-47ac-beac-2035dc51a7c4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.244760 Feb 15 04:21:23.999556 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 109/215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:23 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:24.074686 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:24.087567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-03564f63-a3b9-45ad-8da4-8f301f672f4c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.263189 Feb 15 04:21:24.088194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 107/216] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:23 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:25.016482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:25.017129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:25.024106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:25.024595 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:25.025497 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:25.025937 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:25.106567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:25.107395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:25.115232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:25.115688 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:25.116497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:25.116965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:25.239464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:25.248148 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-19f8aa6c-d6d6-415f-adec-6acc34d5f687 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.235067 Feb 15 04:21:25.248855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 110/217] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:25 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:25.294375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:25.303316 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-89db627d-c43f-4f75-bef5-81f9df5a9a8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.200826 Feb 15 04:21:25.303913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 108/218] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:25 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:26.266099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:26.266827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:26.273785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:26.274236 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:26.275045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:26.275482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:26.322038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:26.322879 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:26.337293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:26.338660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:26.340314 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:26.341367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:26.474007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:26.486514 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b03b39ec-e938-4e60-9630-98262f85ab26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.223971 Feb 15 04:21:26.487232 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 111/219] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:26 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:26.541820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:26.549940 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-902e1a98-0fc0-4067-ac33-082b4f93d1de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1521 microversion: 2.1 time: 0.232021 Feb 15 04:21:26.550536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 109/220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:26 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:27.514622 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:27.516150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:27.523103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:27.523559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:27.524362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:27.524797 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:27.567354 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:27.577386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:27.591174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:27.592060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:27.594231 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:27.595011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:27.726957 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:27.737029 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5db9c1a6-f46e-484b-a2e6-e7e9a9dda0e0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.230423 Feb 15 04:21:27.737734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 112/221] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:27 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:27.793920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:27.802779 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a3a67966-6deb-47b8-b281-19a84d0fb1cf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1501 microversion: 2.1 time: 0.239038 Feb 15 04:21:27.803520 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 110/222] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:27 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:27.821848 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:27.822370 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:27.829530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:27.829979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:27.830780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:27.831213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:27.993725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:28.002612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1ca3b36a-92ac-4e5e-88f7-d1b47beac3d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1517 microversion: 2.1 time: 0.184644 Feb 15 04:21:28.003210 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 113/223] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:27 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:28.755407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:28.756325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:28.763619 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:28.764109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:28.765150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:28.766258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:28.931680 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:28.940142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1d0fc55d-0ecc-4c96-b874-b7b8b4099114 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.188700 Feb 15 04:21:28.940740 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 111/224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:28 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:29.958074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:29.958902 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:29.965890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:29.966349 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:29.967155 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:29.967596 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:30.144211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:30.152645 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d31b5e3e-ab0d-4c30-8851-31f508c50bb8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.198192 Feb 15 04:21:30.159213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 114/225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:29 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:31.179910 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:31.180662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:31.189901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:31.190639 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:31.191720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:31.192429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:31.428605 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:31.443884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-27c469e5-da01-4bcb-ad1d-4e5c78b9780e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.267105 Feb 15 04:21:31.445159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 112/226] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:31 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:32.466610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:32.467660 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:32.479345 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:32.479935 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:32.481248 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:32.481926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:32.670397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:32.679211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7991a9be-98bd-484a-abd3-29394ed0d9a2 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.219321 Feb 15 04:21:32.679805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 115/227] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:32 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:33.699217 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:33.700242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:33.710709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:33.711395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:33.712679 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:33.713482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:33.906425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:33.916127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1a810936-8361-40e7-8a4b-6f0f9fb90d31 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.223071 Feb 15 04:21:33.916806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 113/228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:33 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:34.736136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:34.737215 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:34.744172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:34.744619 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:34.745451 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:34.745882 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:34.773577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lazy-loading 'flavor' on Instance uuid ca522ac8-8430-4ab4-aa43-9de561155e52 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:21:34.863669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d42145a6-972f-43e4-8d82-cbabac008f54 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action" status: 200 len: 32 microversion: 2.1 time: 0.131370 Feb 15 04:21:34.864621 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 116/229] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:21:34 2022] POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 04:21:34.876444 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:34.878082 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:34.886618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:34.887547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:34.888582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:34.889262 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:34.947295 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:34.948531 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:34.961158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:34.963094 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:34.964774 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:34.965555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:35.069553 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:35.077704 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3d0469da-1380-40cc-9ea9-51e0537d6cd1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.207219 Feb 15 04:21:35.078584 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 114/230] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:34 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:35.167668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:35.179034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-10c58ee9-db36-430a-9e2b-961a95c33940 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.242634 Feb 15 04:21:35.179867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 117/231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:34 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:36.097244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:36.097934 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:36.108233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:36.108942 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:36.110856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:36.111586 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:36.197844 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:36.199064 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:36.206894 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:36.207316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:36.208168 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:36.208620 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:36.292869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:36.301498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b713e8fb-9004-4270-9b37-f270c05206de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.209803 Feb 15 04:21:36.302105 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 115/232] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:36 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:36.399612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:36.414433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8d1a9057-3d75-4dc3-b868-5ffd02195ff0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.220288 Feb 15 04:21:36.415462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 118/233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:36 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:37.319383 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:37.320149 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:37.327744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:37.328561 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:37.329417 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:37.329858 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:37.440527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:37.441542 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:37.448527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:37.449006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:37.449821 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:37.450257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:37.491197 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:37.500215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c67686d1-5266-4b6e-8a49-6d92228c1393 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.184134 Feb 15 04:21:37.500830 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 116/234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:37 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:37.616045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:37.630787 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a0e344e6-a496-4d30-8818-6d89d26851ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.194686 Feb 15 04:21:37.631545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 119/235] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:37 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:38.029799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-6d5d7e15-c8ba-4a59-8fc0-3db9d4de776d req-d5e70997-494c-4d7c-acc1-03c602d876f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a44514-834f-40e0-8a03-1f39942e705f", "name": "network-vif-plugged", "status": "completed", "tag": "8b743140-5b15-4189-a9ad-b671dd542c58"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:38.032225 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:21:38.032225 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:21:38.040780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-6d5d7e15-c8ba-4a59-8fc0-3db9d4de776d req-d5e70997-494c-4d7c-acc1-03c602d876f5 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:38.041349 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-6d5d7e15-c8ba-4a59-8fc0-3db9d4de776d req-d5e70997-494c-4d7c-acc1-03c602d876f5 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:38.056574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-6d5d7e15-c8ba-4a59-8fc0-3db9d4de776d req-d5e70997-494c-4d7c-acc1-03c602d876f5 service nova] Creating event network-vif-plugged:8b743140-5b15-4189-a9ad-b671dd542c58 for instance 65a44514-834f-40e0-8a03-1f39942e705f on hv-cinder-81610 Feb 15 04:21:38.070806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-6d5d7e15-c8ba-4a59-8fc0-3db9d4de776d req-d5e70997-494c-4d7c-acc1-03c602d876f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044824 Feb 15 04:21:38.071780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 117/236] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:21:38.518083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:38.518696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:38.525616 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:38.526067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:38.526873 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:38.527309 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:38.657613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:38.659392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:38.672266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:38.673198 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:38.674317 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:38.674830 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:38.724157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:38.737891 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-23fdc905-5089-4844-82a6-bbad1b687e27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.224142 Feb 15 04:21:38.738479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 120/237] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:38 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:39.055935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:39.069882 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9c1548b4-bfde-4645-804c-0f333eae4f18 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.422355 Feb 15 04:21:39.070949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 118/238] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:38 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:39.763936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:39.765311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:39.776887 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:39.777946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:39.783766 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:39.784757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:39.951938 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:39.963754 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4ffeb0f5-1f94-46b9-8dfa-e9f2916b6ff7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.204404 Feb 15 04:21:39.964543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 121/239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:39 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:40.088618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:40.089364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:40.098463 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:40.098829 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:40.099676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:40.100115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:40.276864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:40.287342 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7fa34bdd-fbbb-408b-ae59-26bfaee5eaa1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.202518 Feb 15 04:21:40.288036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 119/240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:40 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:40.982510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:40.983281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:40.989821 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:40.990269 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:40.991080 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:40.991517 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:41.147138 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:41.154927 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-212864fe-2384-4219-9f2a-ca3efeb50c1c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.176300 Feb 15 04:21:41.156193 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 122/241] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:40 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:41.306026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:41.306680 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:41.314783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:41.315340 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:41.316402 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:41.316931 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:41.503047 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:41.510839 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-85bbad78-13df-49b6-982b-29bb11ba5f6d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.208394 Feb 15 04:21:41.511441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 120/242] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:41 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:42.180736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:42.182062 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:42.193410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:42.194003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:42.195989 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:42.195989 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:42.371053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:42.385799 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c59766ae-27c9-4ca1-a4ed-f50b4e69b035 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.208614 Feb 15 04:21:42.386945 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 123/243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:42 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:42.528448 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:42.529084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:42.536118 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:42.536566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:42.537427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:42.537868 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:42.720727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:42.728405 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-433b926b-e875-4575-a39e-4918c7a2fc3e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.203521 Feb 15 04:21:42.729481 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 121/244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:42 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:43.414462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:43.415286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:43.422276 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:43.422724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:43.423525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:43.423954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:43.636097 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:43.646266 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-14b0ce8a-c42d-4767-86a3-26c51efab121 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.236616 Feb 15 04:21:43.646861 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 124/245] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:43 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:43.758971 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:43.760139 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:43.767992 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:43.768507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:43.769419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:43.769892 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:43.932118 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:43.942901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8c035a0c-df02-4237-b58a-021d95c153f4 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1317 microversion: 2.1 time: 0.191141 Feb 15 04:21:43.943657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 122/246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:43 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:44.680129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:44.681706 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:44.692834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:44.693738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:44.695341 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:44.696259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:44.956061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:44.969879 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:44.971213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:44.980244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:44.981241 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:44.982596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:44.983503 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:44.986036 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9b7f357d-f11b-4d70-b23e-e5c99b1e6247 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.311429 Feb 15 04:21:44.987046 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 125/247] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:44 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:45.220002 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:45.232270 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-578af161-e721-4a0f-825e-861797d30e8b tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1507 microversion: 2.1 time: 0.267129 Feb 15 04:21:45.234276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 123/248] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:44 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:46.016420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:46.017067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:46.024590 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:46.025163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:46.026345 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:46.027076 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:46.196735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:46.205995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-93c9be3a-ee4a-4556-8b44-fff327713c6d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.194420 Feb 15 04:21:46.206605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 126/249] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:46 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:47.224375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:47.225525 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:47.232533 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:47.233717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:47.234345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:47.235615 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:47.397713 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:47.407735 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e11668e4-ef02-464e-8192-fb3b0fc75fb6 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.187553 Feb 15 04:21:47.408327 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 124/250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:47 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:48.426449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:48.427330 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:48.434066 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:48.434516 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:48.435321 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:48.435751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:48.612162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:48.620141 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-38e10452-cdc8-429a-a674-c21803fda794 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.198142 Feb 15 04:21:48.620735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 127/251] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:48 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:49.638051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:49.638694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:49.645719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:49.646202 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:49.647052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:49.647520 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:49.829957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:49.838170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-76f3794a-d107-4ae5-9d2d-5782304df360 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.203762 Feb 15 04:21:49.838812 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 125/252] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:49 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:21:50.859962 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:50.861181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:50.872729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:50.873581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:50.875395 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:50.875840 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:51.033923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:51.043788 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4fbac75e-d46d-466a-92c8-3e2452809ebf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.191399 Feb 15 04:21:51.044530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 128/253] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:50 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:52.062917 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:52.063461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:52.069777 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:52.070260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:52.071109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:52.071546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:52.214446 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:52.222938 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-af35fbf5-aa2a-4098-8f20-346665109f93 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.164849 Feb 15 04:21:52.223545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 126/254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:52 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:52.986753 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e50fa975-6fd6-4f43-8f99-2b5f5b2f053f"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:21:52.989388 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:52.997651 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:52.998653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:53.000289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:53.001488 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:53.240504 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:53.241405 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:53.248450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:53.249017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:53.250166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:53.250615 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:53.314778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6a177189-641a-4107-82ff-c8e2221188ed tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332809 Feb 15 04:21:53.315605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 129/255] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:21:52 2022] POST /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:21:53.459512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:53.468600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-74514185-52f4-4be8-bd6c-d397bd5b6e9a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.231414 Feb 15 04:21:53.469697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 127/256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:53 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:54.491394 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:54.492096 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:54.500054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:54.500494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:54.501335 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:54.501775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:54.662867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:54.674447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73d55cdb-b7e0-499e-bed0-80e51eff251d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.183153 Feb 15 04:21:54.675018 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 130/257] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:54 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:55.693029 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:55.693890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:55.702775 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:55.703528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:55.704415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:55.704773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:55.925859 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:55.941174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7e279217-2d55-4a22-b0df-489cfe2b7db4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.251582 Feb 15 04:21:55.942774 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 128/258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:55 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:56.961905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:56.963179 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:56.973607 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:56.974467 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:56.975752 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:56.976348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:57.143663 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:57.155242 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-53742b3f-d935-496c-b3ce-219d915be878 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.198286 Feb 15 04:21:57.156718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 131/259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:56 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:58.178788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:58.179483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:58.187145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:58.187708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:58.188582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:58.189162 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:58.358604 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:58.372456 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7c01c939-3890-41c2-af74-5a3d589c7858 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.196797 Feb 15 04:21:58.373575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 129/260] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:58 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:21:59.391072 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:21:59.391724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:21:59.398582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:59.399052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:59.399891 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:21:59.400316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:21:59.552122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:21:59.559875 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7bb77282-a15b-4e9a-a685-18887f3510af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.173094 Feb 15 04:21:59.560469 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 132/261] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:21:59 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:00.577994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:00.578615 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:00.585360 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:00.585804 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:00.586580 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:00.587004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:00.743413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:00.754454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d49caffb-bfc2-4321-92f0-4210fed3a0dd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.180853 Feb 15 04:22:00.762956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 130/262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:00 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:01.779464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:01.780115 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:01.787203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:01.787662 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:01.788447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:01.789033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:01.869314 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1802783053", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "3aa957fd-094f-4f75-ae1f-c55c6f04f441"}]}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:01.941429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] validate_networks() for [('3aa957fd-094f-4f75-ae1f-c55c6f04f441', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:22:01.996495 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:02.005433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-973389be-ba4f-4aca-bbff-f2e88201e87b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.229483 Feb 15 04:22:02.006027 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 133/263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:01 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:02.324060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:22:02.324554 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:22:02.325054 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:22:02.326070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:22:02.326070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:22:02.335833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:02.336293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:02.337133 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:02.337553 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:02.356569 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Getting quotas for project 7deef946b4134d298ba4916987ac2d8f. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:22:02.361565 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Getting quotas for user ac74cfb4987344d78d987c542aca80d5 and project 7deef946b4134d298ba4916987ac2d8f. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:22:02.375928 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:22:02.378265 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:22:02.438514 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7f736486-ad5e-45a8-aff6-d3d004dde372 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572973 Feb 15 04:22:02.444032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 131/264] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:22:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 04:22:02.449214 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0117496d-2dfa-4df3-912d-b2631d5aa7e9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:02.450123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0117496d-2dfa-4df3-912d-b2631d5aa7e9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:02.520202 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0117496d-2dfa-4df3-912d-b2631d5aa7e9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:02.531933 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0117496d-2dfa-4df3-912d-b2631d5aa7e9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1214 microversion: 2.1 time: 0.086529 Feb 15 04:22:02.532533 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 134/265] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:02 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:03.026449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:03.028766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:03.040777 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:03.041923 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:03.043635 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:03.044932 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:03.230577 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:03.241069 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bffd8b93-af4d-44bb-b9f0-91d19e6beb27 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.220809 Feb 15 04:22:03.241740 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 132/266] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:03 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:03.550483 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:03.551108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:03.557864 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:03.558591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:03.559389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:03.559827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:03.635752 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:03.649045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0d1ed486-c8f6-4119-8232-51a9acce4019 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1210 microversion: 2.1 time: 0.101803 Feb 15 04:22:03.650461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 135/267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:03 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:04.259201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:04.259809 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:04.266583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:04.267039 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:04.267856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:04.268294 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:04.428067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:04.437146 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3c02048f-0da2-4c6f-963b-2b7279652b8a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.181404 Feb 15 04:22:04.437907 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 133/268] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:04 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:04.669471 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:04.670597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:04.677870 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:04.678326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:04.679154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:04.679592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:04.768245 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:04.782362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6ca1643e-5099-4bfc-8dd3-b647822cc66b tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1266 microversion: 2.1 time: 0.117744 Feb 15 04:22:04.783787 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 136/269] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:04 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:05.455020 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:05.455660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:05.462771 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:05.463317 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:05.464190 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:05.464621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:05.618971 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:05.628009 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a927bc75-0dc0-4f51-831e-febd23be118c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.177002 Feb 15 04:22:05.628751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 134/270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:05 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:05.800633 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:05.801302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:05.809410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:05.810101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:05.811768 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:05.812192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:05.898782 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:05.914092 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5ddfa53b-5d5c-4b02-8b78-c940954984e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1284 microversion: 2.1 time: 0.116797 Feb 15 04:22:05.915150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 137/271] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:05 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:06.647711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:06.648309 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:06.655055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:06.655402 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:06.656209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:06.656614 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:06.814024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:06.822473 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f1a7660c-6f4e-4332-9b08-097cc95e45c7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.178585 Feb 15 04:22:06.823229 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 135/272] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:06 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:06.945077 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:06.945966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:06.956348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:06.956919 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:06.958065 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:06.958603 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:07.029122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:07.037852 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4b23f47e-43f0-429f-a177-dfff07b9547d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1284 microversion: 2.1 time: 0.099129 Feb 15 04:22:07.038448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 138/273] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:06 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:07.841133 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:07.841776 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:07.849273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:07.849721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:07.850503 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:07.850931 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:08.007650 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:08.017272 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4367d03b-1b7b-4111-8e58-9ac14bc3a3be tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.179859 Feb 15 04:22:08.017980 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 136/274] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:07 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:08.059207 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:08.061365 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:08.072729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:08.073573 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:08.075010 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:08.075780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:08.148320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:08.158135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ce3b8153-13f2-43ee-9707-847900613feb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1284 microversion: 2.1 time: 0.105791 Feb 15 04:22:08.158724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 139/275] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:08 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:09.037450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:09.038492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:09.048065 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:09.048978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:09.050109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:09.050991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:09.175223 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:09.175851 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:09.182987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:09.183713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:09.184641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:09.185122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:09.236977 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:09.245083 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ec5403c7-6b1e-4996-a047-292b0add5b85 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.213192 Feb 15 04:22:09.245691 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 137/276] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:09 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:09.294119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:09.304594 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-00ec3679-d6b4-44d0-a1cd-23000f8fec3f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1272 microversion: 2.1 time: 0.132968 Feb 15 04:22:09.316611 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 140/277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:09 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:10.268464 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:10.269395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:10.281964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.283319 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.287156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.288353 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.330361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:10.333270 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:10.350585 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.352486 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.354244 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.355875 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.616889 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:10.625148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2dfe3fbc-a9f6-4c76-acac-f626b69f971e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1503 microversion: 2.1 time: 0.360257 Feb 15 04:22:10.626381 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 138/278] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:10 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:10.649519 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6171cae2-079d-4d79-9ed7-1e3b98ec569f"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:10.651098 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:10.658499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.659177 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.660365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.661037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.691087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] HTTP exception thrown: Cannot 'attach_volume' instance ca522ac8-8430-4ab4-aa43-9de561155e52 while it is in vm_state rescued Feb 15 04:22:10.691750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Returning 409 to user: Cannot 'attach_volume' instance ca522ac8-8430-4ab4-aa43-9de561155e52 while it is in vm_state rescued {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:22:10.692774 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b467397a-1e0b-4152-b0d0-d36269a437af tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047596 Feb 15 04:22:10.694849 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 139/279] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:22:10 2022] POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 15 04:22:10.705582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:10.706263 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:10.713497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.714046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.715010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.715472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.805182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:10.817481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bc4a0732-2e7a-4624-be5c-1bdb5e7156e8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.496351 Feb 15 04:22:10.818580 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 141/280] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:10 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:10.850949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-07f4dd93-0ed0-4b92-b0a6-e4ac5298a206 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action" status: 202 len: 0 microversion: 2.1 time: 0.141894 Feb 15 04:22:10.852477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 140/281] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:22:10 2022] POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:22:10.862438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:10.863369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:10.872105 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.873104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.874628 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.875443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:10.921397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-42fd72bf-ea61-4068-b7fa-0dc7ae082023 req-fdf0c7e6-b618-4925-a1c3-b9bb376e253a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a784ebec-292d-48c8-a43f-30f65f845336", "tag": "79b89ad5-360e-4229-91d6-b34eb3843a17"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:10.928147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:10.928147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:22:10.977454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-42fd72bf-ea61-4068-b7fa-0dc7ae082023 req-fdf0c7e6-b618-4925-a1c3-b9bb376e253a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:10.978963 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-42fd72bf-ea61-4068-b7fa-0dc7ae082023 req-fdf0c7e6-b618-4925-a1c3-b9bb376e253a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:11.010256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-42fd72bf-ea61-4068-b7fa-0dc7ae082023 req-fdf0c7e6-b618-4925-a1c3-b9bb376e253a service nova] Creating event network-changed:79b89ad5-360e-4229-91d6-b34eb3843a17 for instance a784ebec-292d-48c8-a43f-30f65f845336 on hv-cinder-81610 Feb 15 04:22:11.021690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-42fd72bf-ea61-4068-b7fa-0dc7ae082023 req-fdf0c7e6-b618-4925-a1c3-b9bb376e253a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113700 Feb 15 04:22:11.023609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 141/282] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:11.278830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:11.289472 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-47870f28-3274-4cad-a6c6-5e69e158cf1a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1511 microversion: 2.1 time: 0.430378 Feb 15 04:22:11.290503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 142/283] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:10 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:11.655966 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e50fa975-6fd6-4f43-8f99-2b5f5b2f053f"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:11.657832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:11.665852 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:11.666579 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:11.667546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:11.668142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:11.778392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] HTTP exception thrown: Invalid volume: volume e50fa975-6fd6-4f43-8f99-2b5f5b2f053f is already attached to instances: 65a44514-834f-40e0-8a03-1f39942e705f Feb 15 04:22:11.779646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Returning 400 to user: Invalid volume: volume e50fa975-6fd6-4f43-8f99-2b5f5b2f053f is already attached to instances: 65a44514-834f-40e0-8a03-1f39942e705f {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:22:11.781023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1003b965-cbf5-42f2-b598-cbe1edb5a10f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135736 Feb 15 04:22:11.783534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 142/284] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:22:11 2022] POST /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:22:11.852928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:11.855377 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:11.871867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:11.873311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:11.875389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:11.876515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:11.933809 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:11.934201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:11.954151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:11.954608 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:11.955425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:11.955873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:12.257713 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lazy-loading 'services' on Instance uuid 65a44514-834f-40e0-8a03-1f39942e705f {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:22:12.313166 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:12.325829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f0c0495d-ffbe-43d3-a608-17d57314a351 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.484187 Feb 15 04:22:12.327287 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 143/285] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:11 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:12.338142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:12.339121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:12.349711 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:12.350875 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:12.351946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:12.352667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:12.411717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-feb5b510-541a-48de-9115-cc477090d04a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments/e50fa975-6fd6-4f43-8f99-2b5f5b2f053f" status: 202 len: 0 microversion: 2.1 time: 0.481826 Feb 15 04:22:12.413194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 143/286] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:22:11 2022] DELETE /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments/e50fa975-6fd6-4f43-8f99-2b5f5b2f053f => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:22:12.425672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:12.427654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:12.438370 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:12.439215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:12.440506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:12.441293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:12.509771 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ea833f5e-82a9-4277-a4c3-0e1c03e8cc00 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091692 Feb 15 04:22:12.510789 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 144/287] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:22:12 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:12.760693 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:12.775936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fc678f35-d89c-47f2-ad57-f41bef8dd6a1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1511 microversion: 2.1 time: 0.447056 Feb 15 04:22:12.777358 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 144/288] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:12 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:13.352566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:13.353789 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:13.368287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:13.381697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:13.382845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:13.383293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:13.526392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:13.528185 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:13.542668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:13.543131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:13.543953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:13.544397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:13.581133 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:13.585928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4d27a85e-0942-4ca5-82e7-67fa5c3b4fca tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065686 Feb 15 04:22:13.587029 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 145/289] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:22:13 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:22:13.594378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-53562e5b-81f9-48de-b010-67bfe6c94f69 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.246630 Feb 15 04:22:13.595199 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 145/290] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:13 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:13.798839 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:13.800021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:13.809418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:13.810224 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:13.812163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:13.813021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:13.998639 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:14.006331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c26cd115-68f4-4aca-a81e-3eab4bfd1387 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1511 microversion: 2.1 time: 0.212537 Feb 15 04:22:14.006911 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 146/291] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:13 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:14.606424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:14.606424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:14.609285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:14.609825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:14.610562 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:14.611187 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:14.618602 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:14.619212 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:14.637462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:14.638125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:14.639864 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:14.647126 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:14.673363 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1178f6f8-f6d1-4d4b-a7f9-33e0438bf700 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076733 Feb 15 04:22:14.674365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 146/292] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:22:14 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:22:14.845481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:14.860215 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-30202c57-063a-49a5-bb6a-7ec165f979b8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.245372 Feb 15 04:22:14.861006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 147/293] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:14 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:14.884411 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1936509669", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "a909d0e6-c4b3-462a-b863-e1bf37a7bf54"}]}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:14.942074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] validate_networks() for [('a909d0e6-c4b3-462a-b863-e1bf37a7bf54', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:22:15.024355 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:15.024994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:15.037108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:15.037643 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:15.038750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:15.039419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:15.202214 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:15.210365 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c55ac94f-b191-42e1-ab13-f6e57c361dc8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1511 microversion: 2.1 time: 0.189744 Feb 15 04:22:15.210986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 148/294] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:15 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:15.371827 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:22:15.372254 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:22:15.373449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:22:15.373957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:22:15.374378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:22:15.384538 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:15.385025 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:15.385841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:15.386277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:15.403137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:22:15.408024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Getting quotas for user a2f544b022f84fb291d0794dca05788d and project 3d7002e2df35463c9128baa00359cd9e. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:22:15.430309 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:22:15.432951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:22:15.484416 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b47e03f1-c04c-4304-91e5-12a13027abda tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603162 Feb 15 04:22:15.485836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 147/295] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:22:15.502308 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2c5be898-f39a-4f44-be4e-fc5b01a6b44f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:15.503326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2c5be898-f39a-4f44-be4e-fc5b01a6b44f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:15.576748 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2c5be898-f39a-4f44-be4e-fc5b01a6b44f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:15.585364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2c5be898-f39a-4f44-be4e-fc5b01a6b44f tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1218 microversion: 2.1 time: 0.090074 Feb 15 04:22:15.586142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 149/296] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:15 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:15.882891 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:15.884147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:15.895348 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:15.896091 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:15.897703 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:15.898444 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:16.132711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:16.148210 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-04fb18a0-8830-4cdd-be19-bce969c6f1b2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.271465 Feb 15 04:22:16.149707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 148/297] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:15 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:16.250908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:16.252070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:16.273812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:16.274764 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:16.276422 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:16.277297 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:16.595524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:16.605539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dc3670fb-0213-4ad7-a8a1-880f90fd875f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1511 microversion: 2.1 time: 0.381123 Feb 15 04:22:16.606455 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 150/298] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:16 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:16.615721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:16.615721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:16.615721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:16.615721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:16.616103 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:16.616103 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:16.714274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:16.752052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-00e58063-fa99-4e9e-b59b-a51c4fcb86c3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1270 microversion: 2.1 time: 0.149103 Feb 15 04:22:16.763112 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 149/299] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:16 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:17.166594 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:17.167692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:17.176552 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:17.177111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:17.177946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:17.178617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:17.466754 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:17.477123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-22525eaf-36d3-458f-80b2-fd2f4899a8a6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.314186 Feb 15 04:22:17.481015 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 151/300] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:17 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:17.630022 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:17.631353 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:17.646721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:17.647547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:17.649155 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:17.650266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:17.777947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:17.779907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:17.804379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:17.805641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:17.807573 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:17.808926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:17.956433 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:17.967841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2af2bbe8-367b-4589-871a-a97538436932 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1517 microversion: 2.1 time: 0.345991 Feb 15 04:22:17.970274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 150/301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:17 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1517 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:18.299685 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:18.313771 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d15f01e2-c646-4b91-8dbb-0e50448f4945 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.538954 Feb 15 04:22:18.315034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 152/302] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:17 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:18.503464 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:18.505477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:18.515783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:18.516999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:18.518301 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:18.518910 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:18.768730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:18.781800 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-710c9f07-cbdc-43c0-a189-3360b5105192 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.286641 Feb 15 04:22:18.782981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 151/303] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:18 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:19.332987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:19.333652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:19.340829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.341337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.342486 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.343352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.402694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-01bef9c6-7352-4ff1-ad1d-c9db18bfb6a4 req-5d799dc1-b40c-460a-a428-d832b8b56775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83bb9e1b-3966-4d2d-96b1-7d4806a550c3", "tag": "1742f07e-2dd0-40ed-9cae-3d28b82b6119"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:19.405124 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:19.405124 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:22:19.416431 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-01bef9c6-7352-4ff1-ad1d-c9db18bfb6a4 req-5d799dc1-b40c-460a-a428-d832b8b56775 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.417207 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-01bef9c6-7352-4ff1-ad1d-c9db18bfb6a4 req-5d799dc1-b40c-460a-a428-d832b8b56775 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.430007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-01bef9c6-7352-4ff1-ad1d-c9db18bfb6a4 req-5d799dc1-b40c-460a-a428-d832b8b56775 service nova] Creating event network-changed:1742f07e-2dd0-40ed-9cae-3d28b82b6119 for instance 83bb9e1b-3966-4d2d-96b1-7d4806a550c3 on hv-cinder-81610 Feb 15 04:22:19.436007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-01bef9c6-7352-4ff1-ad1d-c9db18bfb6a4 req-5d799dc1-b40c-460a-a428-d832b8b56775 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037961 Feb 15 04:22:19.436876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 152/304] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:19.586955 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:19.588214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:19.600768 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.601623 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.603171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.604467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.650517 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:19.659198 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dde20a80-3245-4f43-b32d-460d301bab54 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.330112 Feb 15 04:22:19.660220 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 153/305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:19 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:19.805541 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:19.806203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:19.809835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:19.813529 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.813921 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.814677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.815122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.825292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-645e841e-710c-4de4-af43-8e831ee26b23 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1517 microversion: 2.1 time: 0.245229 Feb 15 04:22:19.846640 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 153/306] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:19 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:19.854997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ef4ce10-7e17-4e67-b50d-91b17dfb69e9"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:19.857201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:19.866115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.866568 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:19.867979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:19.868479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:20.058536 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:20.067582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-792a3d81-1a19-4b2a-976e-e109d18abcd2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.271852 Feb 15 04:22:20.068191 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 154/307] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:19 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:20.249275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9a066d86-e310-4ae4-9ee7-c2c20656cc72 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400939 Feb 15 04:22:20.261122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 154/308] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:22:19 2022] POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:20.271441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-91328736-3ee5-4962-a56e-c2bf10cd03fd req-faaef465-5674-436a-b0c3-1079fb2ba69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a784ebec-292d-48c8-a43f-30f65f845336", "name": "network-vif-plugged", "status": "completed", "tag": "79b89ad5-360e-4229-91d6-b34eb3843a17"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:20.273703 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:20.273703 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:22:20.288880 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-91328736-3ee5-4962-a56e-c2bf10cd03fd req-faaef465-5674-436a-b0c3-1079fb2ba69a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:20.289669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-91328736-3ee5-4962-a56e-c2bf10cd03fd req-faaef465-5674-436a-b0c3-1079fb2ba69a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:20.305545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-91328736-3ee5-4962-a56e-c2bf10cd03fd req-faaef465-5674-436a-b0c3-1079fb2ba69a service nova] Creating event network-vif-plugged:79b89ad5-360e-4229-91d6-b34eb3843a17 for instance a784ebec-292d-48c8-a43f-30f65f845336 on hv-cinder-81610 Feb 15 04:22:20.312132 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-91328736-3ee5-4962-a56e-c2bf10cd03fd req-faaef465-5674-436a-b0c3-1079fb2ba69a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044343 Feb 15 04:22:20.313519 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 155/309] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:22:20.678257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:20.678957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:20.685073 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:20.685684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:20.686940 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:20.687374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:20.878902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:20.886665 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6fc65da6-1a91-4703-8c71-e5631889fb58 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.212816 Feb 15 04:22:20.887252 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 155/310] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:20 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:21.027103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-142432251", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:21.083956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] validate_networks() for None {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:22:21.086471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:21.087123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:21.094062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:21.094515 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:21.095299 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:21.095736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:21.233280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:21.242279 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d85a21b8-31c9-48f6-951e-86026f96cfbc tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.159340 Feb 15 04:22:21.242863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 156/311] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:21 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:21.374510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:22:21.375008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:22:21.375516 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:22:21.375969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:22:21.376385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:22:21.385192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:21.385672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:21.386525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:21.386988 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:21.405971 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Getting quotas for project 78b53aed61c64871a933fa120d337481. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:22:21.409889 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Getting quotas for user 2294d1ced66e410888096922d8185370 and project 78b53aed61c64871a933fa120d337481. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:22:21.421301 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:22:21.423760 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:22:21.471654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-597619b1-fd42-48f2-a9b0-b3a8f7cbe12f tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449684 Feb 15 04:22:21.472296 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 156/312] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:22:21.482983 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bd229ced-ed85-4e27-8fb1-17cbbc65bb92 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:21.483697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bd229ced-ed85-4e27-8fb1-17cbbc65bb92 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:21.545182 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bd229ced-ed85-4e27-8fb1-17cbbc65bb92 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:21.552379 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bd229ced-ed85-4e27-8fb1-17cbbc65bb92 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1214 microversion: 2.1 time: 0.073711 Feb 15 04:22:21.552974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 157/313] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:21 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:21.906354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:21.907462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:21.919433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:21.920545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:21.922066 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:21.922679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:22.111745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:22.120111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fe7dcaa6-4802-43ad-9211-2c085944bb17 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.218645 Feb 15 04:22:22.120719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 157/314] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:21 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:22.260609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:22.262106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:22.270407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:22.270958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:22.271873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:22.272515 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:22.420085 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:22.427715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-386ca6a7-f416-43b5-a667-604b7812bb0a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1314 microversion: 2.1 time: 0.171880 Feb 15 04:22:22.428268 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 158/315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:22 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:22.569954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:22.570591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:22.577110 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:22.577563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:22.578338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:22.578770 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:22.643276 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:22.655598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ce6ba46c-6e05-46be-a3ef-9ad0d5cc052e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1266 microversion: 2.1 time: 0.089273 Feb 15 04:22:22.656204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 158/316] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:22 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:23.139070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:23.139835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:23.145897 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:23.146419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:23.147183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:23.147616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:23.311695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:23.326596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9bb546cb-c68f-40ba-ab65-2061d9455533 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.190933 Feb 15 04:22:23.333280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 159/317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:23 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:23.445253 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:23.446118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:23.453360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:23.453901 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:23.454903 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:23.455343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:23.675784 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:23.676963 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:23.695244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:23.699149 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:23.700950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:23.701426 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:23.739962 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:23.754835 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cecfb9ad-f531-4186-abd5-269bd46799f6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1497 microversion: 2.1 time: 0.313004 Feb 15 04:22:23.770836 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 159/318] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:23 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:23.889846 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:23.898386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-80369c64-63c0-458b-a563-f7e63c2e537e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.229870 Feb 15 04:22:23.899365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 160/319] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:23 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:24.361552 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:24.362543 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:24.364292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:24.365740 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:24.378949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.380495 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.380856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.381692 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.381948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.382533 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.383117 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.383896 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.449827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:22:24.671477 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-440fffd2-5416-448d-bd14-b35beac93952 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 204 len: 0 microversion: 2.1 time: 0.316232 Feb 15 04:22:24.672184 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 160/320] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:22:24 2022] DELETE /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:22:24.681469 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-36370d8d-b6fc-4e37-8704-f9cfe9261123 req-1fc587b2-13a0-49e8-bee5-18b4db600a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4927b63e-4590-4052-9e16-cb21d38af37a", "tag": "e709a868-049d-4654-be1c-480745e89215"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:24.684127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:24.684127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:22:24.693919 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-36370d8d-b6fc-4e37-8704-f9cfe9261123 req-1fc587b2-13a0-49e8-bee5-18b4db600a6a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.695295 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-36370d8d-b6fc-4e37-8704-f9cfe9261123 req-1fc587b2-13a0-49e8-bee5-18b4db600a6a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.723145 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-36370d8d-b6fc-4e37-8704-f9cfe9261123 req-1fc587b2-13a0-49e8-bee5-18b4db600a6a service nova] Creating event network-changed:e709a868-049d-4654-be1c-480745e89215 for instance 4927b63e-4590-4052-9e16-cb21d38af37a on hv-cinder-81610 Feb 15 04:22:24.732746 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-36370d8d-b6fc-4e37-8704-f9cfe9261123 req-1fc587b2-13a0-49e8-bee5-18b4db600a6a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056696 Feb 15 04:22:24.733873 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 161/321] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:24.743834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:24.745229 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:24.784963 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:24.785712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.786571 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.788116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.789070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.793949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9a2d5282-e0ed-4122-b4c1-b579e63238ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.439312 Feb 15 04:22:24.794918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 161/322] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:24 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:24.928874 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:24.929554 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:24.937124 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.937766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:24.938678 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:24.939240 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:25.036112 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:25.045537 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5907535d-f944-4203-93af-ff94b96eebce tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1503 microversion: 2.1 time: 0.309242 Feb 15 04:22:25.046285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 162/323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:24 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:25.098564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:25.105851 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d2ac9b5c-1313-437b-ad96-8abdb9a58d8d tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.181153 Feb 15 04:22:25.106429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 162/324] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:24 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:25.817136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:25.817749 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:25.827917 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:25.828719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:25.830196 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:25.831008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:26.065274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:26.066084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:26.076951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:26.077945 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:26.078885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:26.079418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:26.115067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:26.126185 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-79232b8c-d6e4-40d4-8e5e-e8918ae17584 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.312721 Feb 15 04:22:26.134871 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 163/325] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:25 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:26.134871 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:26.135706 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:26.148098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:26.148926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:26.150374 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:26.151182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:26.260645 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:26.268882 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9c765f2d-2cdf-4b3a-9ccc-54d7bc075177 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1503 microversion: 2.1 time: 0.208943 Feb 15 04:22:26.269493 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 163/326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:26 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:26.359834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:26.367720 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-167c384b-8b9d-4bb6-9948-5e874c339d71 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.239649 Feb 15 04:22:26.368290 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 164/327] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:26 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:27.143659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:27.144884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:27.155311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.156201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.157707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.158478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.286016 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:27.286636 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:27.299091 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.299713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.300578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.301387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.334799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:27.343770 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ffc08646-90e2-49ec-9490-90b42f70a0d8 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.205218 Feb 15 04:22:27.344933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 164/328] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:27 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:27.386436 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:27.387363 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:27.395756 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.396233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.397220 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.397654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.522570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:27.531461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5856097a-e823-4ef0-ad98-c87e74a7ea39 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 200 len: 1503 microversion: 2.1 time: 0.248997 Feb 15 04:22:27.532154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 165/329] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:27 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:27.545900 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:27.553845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7d93ac75-f070-49b2-814f-0437df3c09a4 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.172227 Feb 15 04:22:27.554529 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 165/330] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:27 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:27.680983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-28988fba-6baa-409c-8419-64605d28f066 req-858f91f5-66ae-46cf-a4bb-a26549112b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a784ebec-292d-48c8-a43f-30f65f845336", "name": "network-vif-deleted", "tag": "79b89ad5-360e-4229-91d6-b34eb3843a17"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:27.682939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:27.682939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:22:27.692281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-28988fba-6baa-409c-8419-64605d28f066 req-858f91f5-66ae-46cf-a4bb-a26549112b13 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:27.692685 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-28988fba-6baa-409c-8419-64605d28f066 req-858f91f5-66ae-46cf-a4bb-a26549112b13 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:27.704714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-28988fba-6baa-409c-8419-64605d28f066 req-858f91f5-66ae-46cf-a4bb-a26549112b13 service nova] Creating event network-vif-deleted:79b89ad5-360e-4229-91d6-b34eb3843a17 for instance a784ebec-292d-48c8-a43f-30f65f845336 on hv-cinder-81610 Feb 15 04:22:27.710616 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-28988fba-6baa-409c-8419-64605d28f066 req-858f91f5-66ae-46cf-a4bb-a26549112b13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Feb 15 04:22:27.711398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 166/331] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:28.233268 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-ad2fc3d7-91a4-447f-aa48-cf6545d015de req-9488e27e-8efb-463a-9938-1d1647d2a233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bb9e1b-3966-4d2d-96b1-7d4806a550c3", "name": "network-vif-plugged", "status": "completed", "tag": "1742f07e-2dd0-40ed-9cae-3d28b82b6119"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:28.235212 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:28.235212 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:22:28.244163 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-ad2fc3d7-91a4-447f-aa48-cf6545d015de req-9488e27e-8efb-463a-9938-1d1647d2a233 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.244709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-ad2fc3d7-91a4-447f-aa48-cf6545d015de req-9488e27e-8efb-463a-9938-1d1647d2a233 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.258292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-ad2fc3d7-91a4-447f-aa48-cf6545d015de req-9488e27e-8efb-463a-9938-1d1647d2a233 service nova] Creating event network-vif-plugged:1742f07e-2dd0-40ed-9cae-3d28b82b6119 for instance 83bb9e1b-3966-4d2d-96b1-7d4806a550c3 on hv-cinder-81610 Feb 15 04:22:28.264412 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-ad2fc3d7-91a4-447f-aa48-cf6545d015de req-9488e27e-8efb-463a-9938-1d1647d2a233 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039918 Feb 15 04:22:28.265181 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 166/332] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:28.365645 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:28.369447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:28.382694 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.383457 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.384769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.385743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.553039 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:28.554412 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: a784ebec-292d-48c8-a43f-30f65f845336] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:28.565941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.566975 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.568755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.569699 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.596682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] HTTP exception thrown: Instance a784ebec-292d-48c8-a43f-30f65f845336 could not be found. Feb 15 04:22:28.597618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Returning 404 to user: Instance a784ebec-292d-48c8-a43f-30f65f845336 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:22:28.598796 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-66b46e2b-9a58-4b9c-9a14-64060182ac12 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336" status: 404 len: 111 microversion: 2.1 time: 0.052903 Feb 15 04:22:28.600940 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 167/333] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:28 2022] GET /compute/v2.1/servers/a784ebec-292d-48c8-a43f-30f65f845336 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:22:28.612583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:28.613502 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:28.620969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.621717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.623096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:28.624166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:28.695605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:28.704669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f727590a-ccec-46c2-8df2-51e7804cdb43 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.346649 Feb 15 04:22:28.714261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 167/334] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:28 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:28.749695 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-119362537", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "3aa957fd-094f-4f75-ae1f-c55c6f04f441"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:28.811364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:28.819897 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-27e70497-38de-4550-80c1-317a48590024 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.218894 Feb 15 04:22:28.820458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 168/335] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:28 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:28.822461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] validate_networks() for [('3aa957fd-094f-4f75-ae1f-c55c6f04f441', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:22:28.988134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:28.990055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:29.001224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.002021 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.003415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.004206 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.045117 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lazy-loading 'flavor' on Instance uuid ca522ac8-8430-4ab4-aa43-9de561155e52 {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:22:29.232398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-eef37e58-5f25-4c08-9ed1-c3f428060773 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action" status: 200 len: 32 microversion: 2.1 time: 0.251342 Feb 15 04:22:29.233502 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 169/336] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:22:28 2022] POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:22:29.248566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:29.249922 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:29.257684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.258498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.259713 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.260601 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.270897 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:22:29.271327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:22:29.271792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:22:29.272200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:22:29.272610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:22:29.284629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.285113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.286118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.286560 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.308692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Getting quotas for project 7deef946b4134d298ba4916987ac2d8f. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:22:29.315340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Getting quotas for user ac74cfb4987344d78d987c542aca80d5 and project 7deef946b4134d298ba4916987ac2d8f. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:22:29.340473 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:22:29.340473 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:22:29.427801 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c1a969f9-a7e6-4fc1-a0e3-5dacc64f1e5e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686046 Feb 15 04:22:29.428703 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 168/337] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:22:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:22:29.451629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8e4ea433-e164-4406-962e-7273f3950e8a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:29.453263 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8e4ea433-e164-4406-962e-7273f3950e8a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:29.539309 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:29.550965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-97ef695f-7fad-4576-9e73-bd9ed38841de tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.309830 Feb 15 04:22:29.551761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 170/338] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:29 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:29.603483 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8e4ea433-e164-4406-962e-7273f3950e8a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:29.617221 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8e4ea433-e164-4406-962e-7273f3950e8a tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1213 microversion: 2.1 time: 0.176223 Feb 15 04:22:29.627586 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 169/339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:29 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:29.731829 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:29.733878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:29.745538 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.746605 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.748463 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.749517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.837209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:29.838109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:29.847815 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.848570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.849783 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:29.850979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:29.949990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:29.964132 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7a978eb4-6c62-4c31-ad0d-dd0ffc4ec5bc tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.242326 Feb 15 04:22:29.965236 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 171/340] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:29 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:30.226576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:30.237690 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-49f66f2a-6655-41a7-b01a-e361f273828e tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.404451 Feb 15 04:22:30.238943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 170/341] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:29 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:30.569381 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:30.569908 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:30.577381 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:30.577974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:30.578599 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:30.579145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:30.647002 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:30.648810 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:30.662357 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:30.663265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:30.664750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:30.665712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:30.743986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:30.759983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-85cb7bed-01bd-4e62-a118-babf85f642c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1265 microversion: 2.1 time: 0.117120 Feb 15 04:22:30.761470 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 171/342] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:30 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:30.768142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:30.778358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b70595f4-95a6-4bb2-b4d3-cbe159f0b588 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.212571 Feb 15 04:22:30.779563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 172/343] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:30 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:30.984149 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:30.984786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:30.995616 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:30.996084 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:30.997213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:30.998351 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.272465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:31.273672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:31.286842 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:31.288521 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.290430 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:31.291875 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.313045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:31.321120 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1c134dd8-36a7-4995-bbe1-caac68d2b8e5 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1318 microversion: 2.1 time: 0.341416 Feb 15 04:22:31.332964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 172/344] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:30 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:31.519130 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:31.530702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1f6fc382-835d-487c-8129-63eff65618b2 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.269809 Feb 15 04:22:31.532204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 173/345] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:31 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:31.780201 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:31.781072 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:31.790931 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:31.791653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.793423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:31.794277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.797890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:31.798901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:31.809290 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:31.810048 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.810857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:31.811525 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:31.989333 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:31.998776 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-cee7d64a-ed0a-4d1d-839c-e026d9ecbb31 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.206940 Feb 15 04:22:31.999659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 174/346] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:31 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:32.045535 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:32.061953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-86326f73-d31f-45a2-9f98-07d00eafee7d tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.286605 Feb 15 04:22:32.063209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 173/347] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:31 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:32.339463 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:32.340184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:32.347142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:32.347685 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:32.348490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:32.348958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:32.539728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:32.550170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a48625f8-7d83-4b96-b31c-ee3de272152d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1508 microversion: 2.1 time: 0.214450 Feb 15 04:22:32.550875 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 175/348] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:32 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:32.554914 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:32.556120 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:32.567070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:32.567438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:32.568868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:32.570624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:32.719989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-61834f70-0e1a-4f34-b93d-889260b58da2 req-c1b0e144-6550-4ff6-9f1d-f9afe9cf4149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0882aa-de73-439a-9ba2-d47b87b0feac", "tag": "e7946db1-fe7c-4912-bb5d-ecd8ed3faa00"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:32.724431 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:32.724431 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:22:32.737119 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-61834f70-0e1a-4f34-b93d-889260b58da2 req-c1b0e144-6550-4ff6-9f1d-f9afe9cf4149 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:32.739170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-61834f70-0e1a-4f34-b93d-889260b58da2 req-c1b0e144-6550-4ff6-9f1d-f9afe9cf4149 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:32.775753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-61834f70-0e1a-4f34-b93d-889260b58da2 req-c1b0e144-6550-4ff6-9f1d-f9afe9cf4149 service nova] Creating event network-changed:e7946db1-fe7c-4912-bb5d-ecd8ed3faa00 for instance af0882aa-de73-439a-9ba2-d47b87b0feac on hv-cinder-81610 Feb 15 04:22:32.788255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-61834f70-0e1a-4f34-b93d-889260b58da2 req-c1b0e144-6550-4ff6-9f1d-f9afe9cf4149 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075160 Feb 15 04:22:32.807401 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 176/349] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:32.887563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:32.903462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-052854e5-92f5-4aab-81bd-844722ee3738 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.354928 Feb 15 04:22:32.905675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 174/350] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:32 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:33.026153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:33.027363 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:33.041939 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:33.042990 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:33.046523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:33.048076 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:33.086225 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:33.087428 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:33.099993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:33.101679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:33.103188 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:33.103972 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:33.254280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:33.266480 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b278a12d-3361-4d58-ad48-ffd4f26cc8dc tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.250298 Feb 15 04:22:33.267175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 177/351] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:33 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:33.382897 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:33.393292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-67c09929-4695-43ae-af85-88148c71d6f7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.313787 Feb 15 04:22:33.394171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 175/352] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:33 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:33.933184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:33.933921 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:33.940274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:33.940716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:33.941546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:33.941986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:34.089505 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:34.098936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-713a9da9-1ff3-4e6f-8ef8-51a271ab98a7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.169590 Feb 15 04:22:34.099867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 178/353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:33 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:34.282954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:34.284381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:34.286833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-31c6391f-a067-413a-a979-c8ad405fe39e req-ceeacfcf-64ac-4b92-8338-0c5796c7bbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4927b63e-4590-4052-9e16-cb21d38af37a", "name": "network-vif-plugged", "status": "completed", "tag": "e709a868-049d-4654-be1c-480745e89215"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:34.288727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:34.288727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:22:34.291102 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:34.291583 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:34.292568 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:34.293067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:34.301276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-31c6391f-a067-413a-a979-c8ad405fe39e req-ceeacfcf-64ac-4b92-8338-0c5796c7bbb0 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:34.301777 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-31c6391f-a067-413a-a979-c8ad405fe39e req-ceeacfcf-64ac-4b92-8338-0c5796c7bbb0 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:34.321387 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-31c6391f-a067-413a-a979-c8ad405fe39e req-ceeacfcf-64ac-4b92-8338-0c5796c7bbb0 service nova] Creating event network-vif-plugged:e709a868-049d-4654-be1c-480745e89215 for instance 4927b63e-4590-4052-9e16-cb21d38af37a on hv-cinder-81610 Feb 15 04:22:34.328095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-31c6391f-a067-413a-a979-c8ad405fe39e req-ceeacfcf-64ac-4b92-8338-0c5796c7bbb0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045396 Feb 15 04:22:34.329007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 179/354] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:22:34.415630 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:34.416933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:34.427636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:34.428596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:34.430831 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:34.431614 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:34.501006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:34.515524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c73da8fc-c08d-444d-b982-9f084a49b462 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.236105 Feb 15 04:22:34.516998 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 176/355] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:34 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:34.633086 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:34.642303 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5187b9c5-ce3f-492a-a1be-da10066c36c6 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.234165 Feb 15 04:22:34.643084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 180/356] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:34 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:35.117507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:35.118045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:35.125343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.126206 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.126634 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.126964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.184781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b45fcaa7-31c8-41a2-95b0-2ff23133c6f5"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:35.185972 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:35.195237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.195696 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.196528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.197024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.300542 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:35.308565 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9ba19196-ab53-4bb3-89f8-8babc493343b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.195120 Feb 15 04:22:35.309187 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 177/357] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:35 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:35.491974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a199dd4f-65e5-476e-a977-1dc9b0b83cac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "POST /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312530 Feb 15 04:22:35.492791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 181/358] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:22:35 2022] POST /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:35.534311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:35.534940 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:35.545877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.546329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.547986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.548432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.661856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:35.662950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:35.670123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.670642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.671516 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:35.672014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:35.763711 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:35.772547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c5a607e1-db4d-4687-9c21-0c1f5fb0bda7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.241861 Feb 15 04:22:35.773172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 178/359] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:35 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:35.851714 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:35.860507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a06e7ec9-8aa7-482d-8c60-75821b20d96c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.203688 Feb 15 04:22:35.861204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 182/360] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:35 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:36.335088 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:36.335699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:36.343070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:36.343523 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:36.344327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:36.344762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:36.508526 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:36.517419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1cf1c8d8-27c6-4bae-b725-077fa62c02d7 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.186053 Feb 15 04:22:36.518014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 179/361] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:36 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:36.800998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:36.801616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:36.809280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:36.810345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:36.811258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:36.811699 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:36.879855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:36.881190 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:36.889580 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:36.890199 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:36.891313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:36.892078 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:36.995651 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:37.004884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-89285d3b-b20c-457b-815d-6b3efd0357bf tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.207525 Feb 15 04:22:37.005492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 183/362] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:36 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:37.074751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:37.083851 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-66fb7f5f-fa0f-401e-a517-29a68682c3bb tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.208257 Feb 15 04:22:37.084443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 180/363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:36 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:37.536155 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:37.536669 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:37.543114 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:37.543554 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:37.544604 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:37.545122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:37.705723 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:37.713991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b581ab20-d142-45b8-89be-a8dc59b7b6f9 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1314 microversion: 2.1 time: 0.181443 Feb 15 04:22:37.714596 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 184/364] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:37 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:38.022859 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:38.024257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:38.031262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.031858 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.032874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.033532 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.100765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:38.101782 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:38.109184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.109759 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.110671 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.111503 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.251509 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:38.260648 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-24d410db-bc65-48c7-bc89-948b97bed8df tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.240923 Feb 15 04:22:38.264312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 181/365] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:38 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:38.280145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:38.290314 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9e933233-da8c-41a7-9c75-83ab0e8de7d7 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.193343 Feb 15 04:22:38.290958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 185/366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:38 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:38.735373 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:38.736646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:38.744359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.745011 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.746450 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.747133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.887570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:38.896063 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-86162cb9-983f-43c4-8424-426bdd65164b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1463 microversion: 2.1 time: 0.167329 Feb 15 04:22:38.896657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 182/367] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:38 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:38.941031 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:38.941888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:38.953579 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.954307 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.955419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:38.955863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:38.982341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:22:39.071453 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8ec9a3f0-dd8f-4b5f-8759-f872172fd049 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 204 len: 0 microversion: 2.1 time: 0.136780 Feb 15 04:22:39.072212 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 186/368] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:22:38 2022] DELETE /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:22:39.080265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:39.080878 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:39.087246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:39.087700 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:39.088485 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:39.088947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:39.234146 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:39.241673 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-13b2f19d-75ef-4060-a19e-0ddd498a9c8b tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1469 microversion: 2.1 time: 0.164897 Feb 15 04:22:39.242260 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 183/369] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:39 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:39.277087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:39.277856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:39.284694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:39.285183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:39.285991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:39.286431 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:39.307892 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:39.308497 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:39.314976 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:39.315425 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:39.316213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:39.316641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:39.441003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:39.452886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f3b2af75-e172-45eb-a17d-60031b6bd298 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.179804 Feb 15 04:22:39.462712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 187/370] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:39 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:39.471719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:39.478982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7b75b9fd-53e9-4ab1-afff-8dbb91aaef65 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.174833 Feb 15 04:22:39.479542 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 184/371] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:39 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:40.259029 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:40.259633 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:40.266156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:40.267400 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:40.268195 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:40.268628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:40.414251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:40.421959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-15ed9ab7-435b-4346-b4d7-78474ab4f795 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1469 microversion: 2.1 time: 0.166573 Feb 15 04:22:40.422526 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 188/372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:40 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:40.470657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:40.471363 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:40.478767 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:40.479241 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:40.480013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:40.480450 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:40.495196 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:40.496329 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:40.502162 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:40.502607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:40.503643 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:40.504080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:40.641857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:40.649131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bfd3c5f3-413e-4f7c-91cb-e0662160433f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.157478 Feb 15 04:22:40.649695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 189/373] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:40 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:40.977715 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:40.986714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b7cb93e5-8c67-430b-ad78-72944752c5ba tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.519191 Feb 15 04:22:40.987312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 185/374] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:40 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:41.438898 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:41.439507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:41.446163 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:41.446767 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:41.447714 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:41.448242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:41.626092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:41.643182 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-207506e5-9e4c-4ff5-92d1-39c7480efb96 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1469 microversion: 2.1 time: 0.207834 Feb 15 04:22:41.643770 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 190/375] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:41 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:41.666449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:41.667271 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:41.679753 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:41.680957 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:41.685058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:41.686590 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:41.849638 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-5be1a928-d092-4991-a3b9-1dc03111ca0b req-b8255a1f-68c6-40b0-b066-ce5a1a1d2d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4927b63e-4590-4052-9e16-cb21d38af37a", "name": "network-vif-deleted", "tag": "e709a868-049d-4654-be1c-480745e89215"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:41.852165 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:41.852165 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:22:41.891653 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-5be1a928-d092-4991-a3b9-1dc03111ca0b req-b8255a1f-68c6-40b0-b066-ce5a1a1d2d1d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:41.893371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-5be1a928-d092-4991-a3b9-1dc03111ca0b req-b8255a1f-68c6-40b0-b066-ce5a1a1d2d1d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:41.920627 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-5be1a928-d092-4991-a3b9-1dc03111ca0b req-b8255a1f-68c6-40b0-b066-ce5a1a1d2d1d service nova] Creating event network-vif-deleted:e709a868-049d-4654-be1c-480745e89215 for instance 4927b63e-4590-4052-9e16-cb21d38af37a on hv-cinder-81610 Feb 15 04:22:41.936420 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-5be1a928-d092-4991-a3b9-1dc03111ca0b req-b8255a1f-68c6-40b0-b066-ce5a1a1d2d1d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093550 Feb 15 04:22:41.937120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 191/376] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:22:41.980942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:41.993454 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fe3268f0-ac99-4805-9926-82eee9ec377e tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.329363 Feb 15 04:22:41.997981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 186/377] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:41 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:42.005577 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:42.006260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:42.014853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:42.015256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:42.016042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:42.016505 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:42.195214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:42.211799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b3135f47-8aaa-4b7c-9dba-360dd085e612 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.210214 Feb 15 04:22:42.225707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 192/378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:41 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:42.324101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-52742dc0-962d-4207-ac43-e5b89088a9e0 req-0e6c392b-f9fc-4b79-a7c3-62f23154d557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0882aa-de73-439a-9ba2-d47b87b0feac", "name": "network-vif-plugged", "status": "completed", "tag": "e7946db1-fe7c-4912-bb5d-ecd8ed3faa00"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:42.325879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:42.325879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:22:42.333664 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-52742dc0-962d-4207-ac43-e5b89088a9e0 req-0e6c392b-f9fc-4b79-a7c3-62f23154d557 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:42.334419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-52742dc0-962d-4207-ac43-e5b89088a9e0 req-0e6c392b-f9fc-4b79-a7c3-62f23154d557 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:42.346326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-52742dc0-962d-4207-ac43-e5b89088a9e0 req-0e6c392b-f9fc-4b79-a7c3-62f23154d557 service nova] Creating event network-vif-plugged:e7946db1-fe7c-4912-bb5d-ecd8ed3faa00 for instance af0882aa-de73-439a-9ba2-d47b87b0feac on hv-cinder-81610 Feb 15 04:22:42.351345 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-52742dc0-962d-4207-ac43-e5b89088a9e0 req-0e6c392b-f9fc-4b79-a7c3-62f23154d557 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Feb 15 04:22:42.352126 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 187/379] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:42.661127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:42.661753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:42.668310 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:42.668790 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:42.669646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:42.670082 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:42.709803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:42.710278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:42.710727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lazy-loading 'fault' on Instance uuid 4927b63e-4590-4052-9e16-cb21d38af37a {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:22:42.763653 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2294d1ced66e410888096922d8185370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b53aed61c64871a933fa120d337481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:42.772722 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4f0ff3b5-a348-4579-b5f5-ca72680a7529 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 200 len: 1304 microversion: 2.1 time: 0.115499 Feb 15 04:22:42.773342 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 193/380] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:42 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:43.016653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:43.017901 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:43.029648 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:43.030630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:43.031525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:43.031967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:43.198824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:43.206452 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7749c164-bead-4c8b-bc26-95cec29798c8 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.197668 Feb 15 04:22:43.207028 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 188/381] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:43 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:43.238785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:43.239458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:43.245653 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:43.246365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:43.247919 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:43.248606 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:43.393224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:43.401205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-80bc104d-7b1f-4ba3-98bb-7a8dd954a9d4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.166156 Feb 15 04:22:43.401777 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 194/382] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:43 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:43.791799 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:43.792419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] [instance: 4927b63e-4590-4052-9e16-cb21d38af37a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:43.799482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:43.799926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:43.800720 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:43.801196 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:43.817563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] HTTP exception thrown: Instance 4927b63e-4590-4052-9e16-cb21d38af37a could not be found. Feb 15 04:22:43.818158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] Returning 404 to user: Instance 4927b63e-4590-4052-9e16-cb21d38af37a could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:22:43.818987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d74548f8-1033-4e61-8f62-15741cbc4917 tempest-VolumesNegativeTest-1353346175 tempest-VolumesNegativeTest-1353346175-project] 10.222.0.45 "GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a" status: 404 len: 111 microversion: 2.1 time: 0.031467 Feb 15 04:22:43.819548 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 189/383] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:43 2022] GET /compute/v2.1/servers/4927b63e-4590-4052-9e16-cb21d38af37a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:22:44.224441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:44.225580 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:44.234418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:44.235035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:44.236058 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:44.236683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:44.422247 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:44.424926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:44.426094 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:44.430592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-daa020ae-8e95-4819-9ed7-93cc208ebb08 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1313 microversion: 2.1 time: 0.211359 Feb 15 04:22:44.431180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 195/384] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:44 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:44.437083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:44.437923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:44.439239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:44.439691 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:44.650552 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:44.659355 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9560685e-aae2-4e50-bf38-eea5ddeb4eb4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.243008 Feb 15 04:22:44.660022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 190/385] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:44 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:45.448674 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:45.449364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:45.459741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:45.460210 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:45.463488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:45.463488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:45.616820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:45.625900 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6da2c57f-fc07-46e1-9d92-f1718911f78c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1496 microversion: 2.1 time: 0.180850 Feb 15 04:22:45.626500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 196/386] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:45 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:45.677416 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:45.678742 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:45.686075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:45.686524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:45.687321 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:45.688013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:45.914326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:45.929479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3031fee3-d147-4911-b71f-2877cc10d220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.255185 Feb 15 04:22:45.930673 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 191/387] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:45 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:46.957298 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:46.957902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:46.964598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:46.965083 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:46.965896 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:46.966557 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:47.108441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:47.116864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b557bea3-b502-41bc-92c0-d8754d7cf0e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.164752 Feb 15 04:22:47.117546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 197/388] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:46 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:48.135455 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:48.136069 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:48.143501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:48.143943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:48.144734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:48.145204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:48.289911 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:48.298439 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bcf183bd-fd62-4525-a77f-ac41250996c3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.166580 Feb 15 04:22:48.299018 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 192/389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:48 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:49.317056 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:49.317723 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:49.324681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:49.325428 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:49.326285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:49.326716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:49.504208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:49.517080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-51b94beb-1e32-4bca-a6da-fb66dee212ad tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.203698 Feb 15 04:22:49.517669 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 198/390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:49 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:50.533285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:50.533897 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:50.540339 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:50.540794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:50.541617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:50.542058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:50.731762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:50.740753 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-22dbdc5a-6cdf-493f-8571-a592ccdcc997 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.211334 Feb 15 04:22:50.741626 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 193/391] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:50 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:51.758659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:51.759350 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:51.766938 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:51.767382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:51.768171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:51.768600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:51.910883 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:51.918712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6bd4a862-6ff4-4536-badd-d1be5fae4989 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.164068 Feb 15 04:22:51.919287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 199/392] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:51 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:52.935992 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:52.937639 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:52.944362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:52.944808 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:52.945622 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:52.946052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:53.091055 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:53.099756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-45c65a5b-4bf0-4262-8c48-f5b249726d74 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.167428 Feb 15 04:22:53.100331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 194/393] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:52 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:54.116429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:54.117122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:54.123811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:54.124391 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:54.125238 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:54.125678 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:54.458461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:54.468032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dc86a71d-b4a8-4ed9-a1a3-34cb1a252c8f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.354575 Feb 15 04:22:54.468618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 200/394] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:54 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:55.490750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:55.491714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:55.504830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:55.505605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:55.506598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:55.507027 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:55.659732 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:55.668308 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8c690bc3-26d5-4891-852d-e1afff98d7e1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.186022 Feb 15 04:22:55.669149 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 195/395] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:55 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:55.834192 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:55.835382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:55.841968 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:55.843024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:55.843837 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:55.844448 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:55.881019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:22:55.971509 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-133ef546-8c4e-486a-b382-6dc4b7f783e2 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "DELETE /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 204 len: 0 microversion: 2.1 time: 0.140607 Feb 15 04:22:55.973457 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 201/396] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:22:55 2022] DELETE /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:22:55.982695 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:55.983392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:55.989756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:55.990217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:55.991002 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:55.991719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:56.148105 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:56.162378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a3be488a-276f-4147-8f0e-7bcdafd0588c tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1502 microversion: 2.1 time: 0.182915 Feb 15 04:22:56.163397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 196/397] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:55 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:56.689823 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:56.690720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:56.698895 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:56.699511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:56.700445 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:56.701074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:56.871219 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:56.885265 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e1228b79-c32a-4a75-a65b-f7006d4a9320 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.201078 Feb 15 04:22:56.885937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 202/398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:56 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:57.181402 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:57.182658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:57.191701 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:57.192343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:57.193381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:57.193826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:57.362924 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:57.372004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1aaf482d-f297-4317-a914-1bf4a33c2085 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1502 microversion: 2.1 time: 0.195410 Feb 15 04:22:57.372797 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 197/399] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:57 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:57.902242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:57.902986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:57.911943 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:57.912719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:57.914214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:57.914824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.074816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:58.075509 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:58.082529 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:58.083329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.084352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:58.085148 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.153445 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:58.166924 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-eaaceec9-5436-4d7e-9069-a6b185d392ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.268293 Feb 15 04:22:58.167880 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 203/400] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:57 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:58.229176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lazy-loading 'services' on Instance uuid 83bb9e1b-3966-4d2d-96b1-7d4806a550c3 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:22:58.367932 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d3584189-3d5a-4292-bbba-30174da98a51 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments/b45fcaa7-31c8-41a2-95b0-2ff23133c6f5" status: 202 len: 0 microversion: 2.1 time: 0.296876 Feb 15 04:22:58.368671 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 198/401] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:22:58 2022] DELETE /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments/b45fcaa7-31c8-41a2-95b0-2ff23133c6f5 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:22:58.390413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:58.392611 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:58.394131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:58.394332 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:58.406162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:58.406625 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.409981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:58.410868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.411937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:58.412620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.413666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:58.414340 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:58.473770 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7a3c1709-825f-497e-aef4-84184f64ab4d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099960 Feb 15 04:22:58.474660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 204/402] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:22:58 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:22:58.617956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:58.629030 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8ed0de35-dc61-44c9-9f11-fca0a73d4d9f tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1502 microversion: 2.1 time: 0.240879 Feb 15 04:22:58.629979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 199/403] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:58 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:22:59.187288 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:59.188690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:59.198353 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.199173 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.200229 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.201223 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.206612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-2cd81065-fc58-48b5-b494-1307765d5530 req-ec06a7c5-47a0-40dc-ad6e-a80b74726e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0882aa-de73-439a-9ba2-d47b87b0feac", "name": "network-vif-deleted", "tag": "e7946db1-fe7c-4912-bb5d-ecd8ed3faa00"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:22:59.208779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:22:59.208779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:22:59.218919 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-2cd81065-fc58-48b5-b494-1307765d5530 req-ec06a7c5-47a0-40dc-ad6e-a80b74726e25 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.219742 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-2cd81065-fc58-48b5-b494-1307765d5530 req-ec06a7c5-47a0-40dc-ad6e-a80b74726e25 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.238310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-2cd81065-fc58-48b5-b494-1307765d5530 req-ec06a7c5-47a0-40dc-ad6e-a80b74726e25 service nova] Creating event network-vif-deleted:e7946db1-fe7c-4912-bb5d-ecd8ed3faa00 for instance af0882aa-de73-439a-9ba2-d47b87b0feac on hv-cinder-81610 Feb 15 04:22:59.248202 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-2cd81065-fc58-48b5-b494-1307765d5530 req-ec06a7c5-47a0-40dc-ad6e-a80b74726e25 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045529 Feb 15 04:22:59.253266 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 200/404] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:22:59.489794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:59.491024 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:59.500222 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.500735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.501798 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.502243 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.552292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:59.561383 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ce996895-007e-4f76-9cc4-a84a176ad60d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.379921 Feb 15 04:22:59.562259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 205/405] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:59 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:22:59.565682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-47436160-c1c4-4368-ab22-8474c9e0d3ba tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082882 Feb 15 04:22:59.566503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 201/406] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:22:59 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:22:59.646057 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:22:59.646781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:22:59.653867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.654755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.655973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.656637 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.724749 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:22:59.725459 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:22:59.726056 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lazy-loading 'fault' on Instance uuid af0882aa-de73-439a-9ba2-d47b87b0feac {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:22:59.791242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:22:59.800350 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-51dccf7b-fbfe-4f75-8cb2-82bc364b01ba tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1303 microversion: 2.1 time: 0.157830 Feb 15 04:22:59.801224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 206/407] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:22:59 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:00.581465 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:00.582083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:00.583639 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:00.584589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:00.588941 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.589406 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.590217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.590651 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.596722 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.597201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.598013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.598511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.635834 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-961fdd2e-a938-491a-92c2-82e8ed0337da tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055830 Feb 15 04:23:00.637343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 207/408] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:00 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:00.822490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:00.823606 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:00.834648 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.837043 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.838036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.840028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.882958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:00.883411 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:00.883868 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lazy-loading 'fault' on Instance uuid af0882aa-de73-439a-9ba2-d47b87b0feac {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:00.944325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac74cfb4987344d78d987c542aca80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7deef946b4134d298ba4916987ac2d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:00.956872 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2964ce69-0780-4f2e-8e4d-64959e7a12b9 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 200 len: 1303 microversion: 2.1 time: 0.140780 Feb 15 04:23:00.959172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 208/409] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:00 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:01.181562 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:01.194888 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b482680f-2147-4e15-8d35-7a21668076ec tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.618631 Feb 15 04:23:01.207843 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 202/410] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:00 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:01.651029 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:01.653052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:01.660430 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:01.661247 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:01.662306 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:01.662977 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:01.700845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-590802c5-1f55-41a4-ab56-b9305d0cc2f3 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053666 Feb 15 04:23:01.702894 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 209/411] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:01 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:01.992967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:01.995394 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] [instance: af0882aa-de73-439a-9ba2-d47b87b0feac] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:02.012172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:02.014593 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:02.016119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:02.017211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:02.047387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] HTTP exception thrown: Instance af0882aa-de73-439a-9ba2-d47b87b0feac could not be found. Feb 15 04:23:02.049478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] Returning 404 to user: Instance af0882aa-de73-439a-9ba2-d47b87b0feac could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:02.052699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-787b330b-7da1-4e6b-9476-ca92eede9ea1 tempest-VolumesActionsTest-1227709341 tempest-VolumesActionsTest-1227709341-project] 10.222.0.45 "GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac" status: 404 len: 111 microversion: 2.1 time: 0.070589 Feb 15 04:23:02.053818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 203/412] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:01 2022] GET /compute/v2.1/servers/af0882aa-de73-439a-9ba2-d47b87b0feac => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:02.216436 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:02.217610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:02.232088 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:02.234065 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:02.237697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:02.238485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:02.505919 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:02.516151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8c63395d-7ab8-4d0f-b8a1-06652d7ba7e4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.303722 Feb 15 04:23:02.526733 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 210/413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:02 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:02.716694 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:02.719322 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:02.741004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:02.746624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:02.746624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:02.746624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:02.845478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-15ff610f-aaad-42ae-833f-4a2814be449c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131720 Feb 15 04:23:02.846628 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 204/414] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:02 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:03.536318 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:03.537587 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:03.550749 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:03.551506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:03.552575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:03.553262 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:03.857980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:03.858954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:03.870853 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:03.871304 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:03.872121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:03.878200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:03.954283 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ad398d28-ad5e-46e5-935d-07f65ffd9031 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100446 Feb 15 04:23:03.959786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 205/415] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:03 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:23:04.208810 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:04.217926 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-69de8402-d245-4710-bb64-69e0ba618d68 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.684796 Feb 15 04:23:04.220494 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 211/416] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:03 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:04.966687 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:04.968401 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:04.974778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:04.975162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:04.975972 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:04.976408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:05.013544 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0266599c-75d1-4e37-b32a-612c4fc80eef tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Feb 15 04:23:05.014849 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 206/417] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:04 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:05.239161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:05.239814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:05.247188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:05.249544 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:05.256424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:05.258647 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:05.506366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:05.514829 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0c508dcc-743d-4319-98bc-1d14a020a020 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.280351 Feb 15 04:23:05.519874 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 212/418] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:05 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:06.025676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:06.026737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:06.036844 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:06.037705 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:06.039042 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:06.039629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:06.085083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-69af2343-3307-4625-88a0-81ef5b2d4368 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063251 Feb 15 04:23:06.085585 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 207/419] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:06 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:06.532243 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:06.533167 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:06.541629 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:06.542404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:06.543864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:06.544628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:06.753168 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:06.774437 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-db0dcba4-8235-438f-9285-db0201bfcfc4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.246303 Feb 15 04:23:06.775428 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 213/420] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:06 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:07.101908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:07.105107 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:07.113534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:07.113982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:07.114778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:07.115212 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:07.163402 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8060b285-92a7-4b47-ba79-1f9b3b049fbb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070022 Feb 15 04:23:07.164427 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 208/421] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:07 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:07.792924 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:07.794230 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:07.801641 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:07.802405 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:07.803425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:07.804058 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:08.155690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:08.174003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e0f735af-e552-4dd8-8fc4-e78054479425 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.384118 Feb 15 04:23:08.174798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 214/422] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:07 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:08.178136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:08.178136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:08.190769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:08.195139 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:08.196036 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:08.196476 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:08.246093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-64d69c32-32a3-4880-9290-a4661c770d06 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074012 Feb 15 04:23:08.247278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 209/423] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:08 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:09.192187 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:09.193915 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:09.202983 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:09.209277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:09.220427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:09.220987 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:09.259329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:09.260607 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:09.275729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:09.276189 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:09.277003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:09.279593 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:09.325084 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-63eeba39-3eb2-4370-b70f-64055450575e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070637 Feb 15 04:23:09.327285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 210/424] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:09 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:09.604698 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:09.617593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-df79dffd-6afa-4dc3-aa39-6f0d02184135 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1569 microversion: 2.1 time: 0.428889 Feb 15 04:23:09.629478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 215/425] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:09 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1569 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:10.337885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:10.339709 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:10.347574 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.348018 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.349047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.349487 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.381245 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6e1adc5a-fbd1-4fe6-b985-13bbb98e8822 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047068 Feb 15 04:23:10.386040 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 211/426] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:10 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:10.640620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:10.641787 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:10.654245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.654761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.656745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.657549 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.861131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:10.868999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8bae416d-9b41-45d4-8968-ac3ee9697286 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1549 microversion: 2.1 time: 0.236395 Feb 15 04:23:10.869573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 216/427] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:10 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:10.885309 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:10.885831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:10.892918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.893740 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.894531 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.894966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.979776 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] HTTP exception thrown: Cannot 'detach_volume' instance ca522ac8-8430-4ab4-aa43-9de561155e52 while it is in vm_state rescued Feb 15 04:23:10.980385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Returning 409 to user: Cannot 'detach_volume' instance ca522ac8-8430-4ab4-aa43-9de561155e52 while it is in vm_state rescued {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:10.981466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-63e01f90-3325-47cd-8d83-71ab8facdfbd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments/9ef4ce10-7e17-4e67-b50d-91b17dfb69e9" status: 409 len: 152 microversion: 2.1 time: 0.100076 Feb 15 04:23:10.982025 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 212/428] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:23:10 2022] DELETE /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments/9ef4ce10-7e17-4e67-b50d-91b17dfb69e9 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 15 04:23:10.990400 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:10.990945 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:10.998259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.998707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:10.999518 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:10.999950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:11.112159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8d493082-33ad-489d-9ce6-ea2ce33c650e tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action" status: 202 len: 0 microversion: 2.1 time: 0.124629 Feb 15 04:23:11.113709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 217/429] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:23:10 2022] POST /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:23:11.128535 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:11.129306 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:11.136320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:11.136722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:11.137675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:11.138331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:11.399170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:11.400497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:11.417216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:11.417903 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:11.419536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:11.420744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:11.470902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e0a572f6-7aae-444b-9715-1356908d6a26 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078385 Feb 15 04:23:11.494521 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 218/430] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:11 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 04:23:11.587581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:11.612539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c8412a71-012a-4b99-90e2-e93fd284b4aa tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1557 microversion: 2.1 time: 0.494071 Feb 15 04:23:11.616699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 213/431] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:11 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1557 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:12.259479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-456339124", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "1623b098-48ca-48ad-88dc-118d6853c0b8"}]}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:12.638050 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:12.638829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:12.652950 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:12.653411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:12.654360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:12.654997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:12.962806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:12.976210 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-eceb0a97-61b9-4d67-bc08-ae0b4ae2222f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1557 microversion: 2.1 time: 0.341773 Feb 15 04:23:12.976830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 214/432] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:12 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1557 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:13.002697 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:13.003747 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:13.022875 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:13.032115 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:13.033608 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:13.034252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:13.115953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:23:13.452577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-96c67d46-3769-4d50-b415-45b22909392c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 204 len: 0 microversion: 2.1 time: 0.466968 Feb 15 04:23:13.454090 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 215/433] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:23:12 2022] DELETE /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:13.467684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:13.468437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:13.501104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:13.501686 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:13.502548 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:13.502996 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:13.884249 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:13.896888 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8fff8ca6-ceea-4837-a4e2-bff4d7292449 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1514 microversion: 2.1 time: 0.436427 Feb 15 04:23:13.897903 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 216/434] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:13 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1514 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:13.994750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:13.995625 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:14.004555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:14.011315 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:14.012331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:14.012784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:14.307982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:14.317501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1103dc82-5ef1-4123-8e64-2c30712b9f4a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1557 microversion: 2.1 time: 0.325405 Feb 15 04:23:14.329034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 217/435] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:13 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1557 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:14.915463 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:14.917183 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:14.934972 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:14.935843 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:14.937443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:14.938196 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:15.332175 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:15.342868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a8c7667a-b2a3-428c-815a-c8d1f371a492 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1514 microversion: 2.1 time: 0.430991 Feb 15 04:23:15.348802 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 218/436] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:14 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:15.353727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:15.361913 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:15.373765 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:15.374312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:15.379938 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:15.380482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:15.755216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:15.765040 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-84f33af0-4304-42d7-8efe-72e39dfacace tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1557 microversion: 2.1 time: 0.414721 Feb 15 04:23:15.767947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 219/437] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:15 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1557 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:16.366007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:16.366794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:16.387340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:16.388103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:16.390207 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:16.390883 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:16.964653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:16.977937 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d26bfa3a-5187-43cf-9488-a2c8eddd881e tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 200 len: 1514 microversion: 2.1 time: 0.615792 Feb 15 04:23:16.978723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 220/438] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:16 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 1514 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:16.996023 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:17.005555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:17.021003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:17.027271 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:17.028539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:17.030816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:17.607618 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:17.632218 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5db3b58d-9a6e-480c-9042-0d1b409a8134 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1563 microversion: 2.1 time: 0.639683 Feb 15 04:23:17.633459 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 221/439] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:16 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1563 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:17.658020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-84cdb6cc-af9c-44cf-a398-b8ea4aef72ae req-34af6106-6401-44bc-a2d9-a654a38bc48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bb9e1b-3966-4d2d-96b1-7d4806a550c3", "name": "network-vif-deleted", "tag": "1742f07e-2dd0-40ed-9cae-3d28b82b6119"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:17.660854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:17.660854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:23:17.679732 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-84cdb6cc-af9c-44cf-a398-b8ea4aef72ae req-34af6106-6401-44bc-a2d9-a654a38bc48f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:17.680576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-84cdb6cc-af9c-44cf-a398-b8ea4aef72ae req-34af6106-6401-44bc-a2d9-a654a38bc48f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:17.713592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-84cdb6cc-af9c-44cf-a398-b8ea4aef72ae req-34af6106-6401-44bc-a2d9-a654a38bc48f service nova] Creating event network-vif-deleted:1742f07e-2dd0-40ed-9cae-3d28b82b6119 for instance 83bb9e1b-3966-4d2d-96b1-7d4806a550c3 on hv-cinder-81610 Feb 15 04:23:17.722587 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-84cdb6cc-af9c-44cf-a398-b8ea4aef72ae req-34af6106-6401-44bc-a2d9-a654a38bc48f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087167 Feb 15 04:23:17.731249 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 222/440] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:17.754375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:17.755322 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:17.763207 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:17.764186 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:17.765258 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:17.765920 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:17.885930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lazy-loading 'services' on Instance uuid ca522ac8-8430-4ab4-aa43-9de561155e52 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:18.051307 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-efb32fb8-e803-460f-b0b1-2c0cf19476c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments/9ef4ce10-7e17-4e67-b50d-91b17dfb69e9" status: 202 len: 0 microversion: 2.1 time: 0.300754 Feb 15 04:23:18.054867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 223/441] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:23:17 2022] DELETE /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments/9ef4ce10-7e17-4e67-b50d-91b17dfb69e9 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:23:18.072859 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:18.074048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 83bb9e1b-3966-4d2d-96b1-7d4806a550c3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:18.094587 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:18.097554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:18.098452 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:18.100175 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:18.137531 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] HTTP exception thrown: Instance 83bb9e1b-3966-4d2d-96b1-7d4806a550c3 could not be found. Feb 15 04:23:18.138435 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Returning 404 to user: Instance 83bb9e1b-3966-4d2d-96b1-7d4806a550c3 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:18.143892 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fd4f74e7-9275-49df-9b04-e2c4d4769d64 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3" status: 404 len: 111 microversion: 2.1 time: 0.082791 Feb 15 04:23:18.147665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 224/442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:18 2022] GET /compute/v2.1/servers/83bb9e1b-3966-4d2d-96b1-7d4806a550c3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:18.160601 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:18.172700 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:18.182641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:23:18.182976 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments (ip 10.222.0.45) !!! Feb 15 04:23:18.199557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:18.200162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:18.201061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:18.202441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:18.251027 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-068f555c-a551-47ac-9393-5dd4b7201662 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104648 Feb 15 04:23:18.253441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 225/443] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:18 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:19.268007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:19.269387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:19.299617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:19.313577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:19.314736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:19.315278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:19.567453 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e2bc166b-db1b-4aa2-bc8a-b3d1ba7526a3 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.306865 Feb 15 04:23:19.572166 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 226/444] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:23:19 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52/os-volume_attachments => generated 25 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:23:19.579163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:19.579699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:19.597731 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:19.598206 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:19.599012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:19.599438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:19.659692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:23:19.855012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5976e8ea-ac53-4ada-b031-1b84fa234925 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 204 len: 0 microversion: 2.1 time: 0.281256 Feb 15 04:23:19.855809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 227/445] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:23:19 2022] DELETE /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:19.876151 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:19.877257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:19.885127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:19.885577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:19.887095 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:19.887554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:20.159406 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:20.175884 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6b108c93-9f9f-45c0-a8b6-8d3f646962c1 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1513 microversion: 2.1 time: 0.313318 Feb 15 04:23:20.178424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 228/446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:19 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:21.196204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:21.197991 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:21.210836 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:21.211965 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:21.217178 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:21.217980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:21.552949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:21.597723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fd83ac96-3dfc-4d20-9437-3f86e2d4c513 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1513 microversion: 2.1 time: 0.401978 Feb 15 04:23:21.604115 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 229/447] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:21 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:22.284362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:22.285112 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:22.317073 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:22.318058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:22.319643 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:22.320578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:22.391472 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:23:22.595250 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d9d2b5b1-139a-4135-9c75-ad85622a35ae tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 204 len: 0 microversion: 2.1 time: 0.318209 Feb 15 04:23:22.599312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 230/448] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:23:22 2022] DELETE /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:22.612454 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:22.614090 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:22.637676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:22.639373 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:22.640561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:22.641135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:22.916408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:22.934252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2c7f92c7-28d4-4e79-89ca-0c5fc30f805f tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1507 microversion: 2.1 time: 0.331212 Feb 15 04:23:22.944180 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 231/449] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:22 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:22.954983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:22.955836 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:22.962409 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:22.962842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:22.963623 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:22.964206 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:23.161020 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:23:23.162391 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:23:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Feb 15 04:23:23.805059 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:23.817683 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8445dc7f-bc97-479e-91d8-a41eb65c5358 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1513 microversion: 2.1 time: 0.871316 Feb 15 04:23:23.817926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 232/450] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:22 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1513 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:23.955695 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:23.956780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:23.967945 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:23.968757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:23.970982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:23.971778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:24.294326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:24.310781 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-26a4adc3-a8ff-4576-9c38-ce1c3480d2f0 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1507 microversion: 2.1 time: 0.362337 Feb 15 04:23:24.313676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 233/451] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:23 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:24.323461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-c2bba817-ec36-4dc2-8070-b9cb561e751d req-1aaee3d7-fd9a-41a6-ae3d-42d6c6223b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a44514-834f-40e0-8a03-1f39942e705f", "name": "network-vif-deleted", "tag": "8b743140-5b15-4189-a9ad-b671dd542c58"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:24.327868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:24.327868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:23:24.340889 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-c2bba817-ec36-4dc2-8070-b9cb561e751d req-1aaee3d7-fd9a-41a6-ae3d-42d6c6223b9a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:24.342413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-c2bba817-ec36-4dc2-8070-b9cb561e751d req-1aaee3d7-fd9a-41a6-ae3d-42d6c6223b9a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:24.380605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-c2bba817-ec36-4dc2-8070-b9cb561e751d req-1aaee3d7-fd9a-41a6-ae3d-42d6c6223b9a service nova] Creating event network-vif-deleted:8b743140-5b15-4189-a9ad-b671dd542c58 for instance 65a44514-834f-40e0-8a03-1f39942e705f on hv-cinder-81610 Feb 15 04:23:24.392063 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-c2bba817-ec36-4dc2-8070-b9cb561e751d req-1aaee3d7-fd9a-41a6-ae3d-42d6c6223b9a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075500 Feb 15 04:23:24.397098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 234/452] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:24.855233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:24.858205 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:24.899960 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:24.902134 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:24.911153 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:24.914075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:24.999665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:25.000006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:25.000493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lazy-loading 'fault' on Instance uuid 65a44514-834f-40e0-8a03-1f39942e705f {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:25.052647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:25.062775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef5ebbcb-a4c2-4594-93b9-b1ecb01366ac tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 200 len: 1307 microversion: 2.1 time: 0.227773 Feb 15 04:23:25.064062 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 235/453] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:24 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:25.332213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:25.333149 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:25.348868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:25.348868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:25.348868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:25.349571 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:25.503956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.network.neutron [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] validate_networks() for [('1623b098-48ca-48ad-88dc-118d6853c0b8', None, None, None, None, None)] {{(pid=116305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:23:25.609157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:25.617209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2686fe44-bf59-453a-a11c-04981074047b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1507 microversion: 2.1 time: 0.291434 Feb 15 04:23:25.627410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 236/454] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:25 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:25.632653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c2342c02-e64b-45da-8fd0-3e26068713b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Action: 'create', calling method: .version_select at 0x7fc5d5ec7ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-463541621"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:25.647478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-c2342c02-e64b-45da-8fd0-3e26068713b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Getting quotas for project b58d87f4f4ed448f8d45c85f92cf1462. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:23:25.651845 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-c2342c02-e64b-45da-8fd0-3e26068713b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Getting quotas for user 94835c1fe2b64e06b994878d1143ed54 and project b58d87f4f4ed448f8d45c85f92cf1462. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:23:25.757108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-c2342c02-e64b-45da-8fd0-3e26068713b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Getting quotas for project b58d87f4f4ed448f8d45c85f92cf1462. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:23:25.765929 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-c2342c02-e64b-45da-8fd0-3e26068713b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Getting quotas for user 94835c1fe2b64e06b994878d1143ed54 and project b58d87f4f4ed448f8d45c85f92cf1462. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:23:25.785333 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c2342c02-e64b-45da-8fd0-3e26068713b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.156501 Feb 15 04:23:25.786140 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 237/455] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Feb 15 04:23:25 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:25.861667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-727094015", "imageRef": "47311eca-3116-4f16-8073-05d70a9a79bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-463541621", "networks": [{"uuid": "39d3cd4d-57c3-40cb-8011-c5fa1fae7cc8"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:26.015234 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] validate_networks() for [('39d3cd4d-57c3-40cb-8011-c5fa1fae7cc8', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:23:26.086730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Flavor limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:23:26.087157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Image limits 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:23:26.088334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Flavor pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:23:26.089188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Image pref 0:0:0 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:23:26.089983 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.virt.hardware [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:23:26.116092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.116830 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.120935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.123490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.167750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Getting quotas for project 1ba3b5e2169b40148cfb3daa6fb61162. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:23:26.175355 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Getting quotas for user 956bd79de25a40aca93e520cfaa296bd and project 1ba3b5e2169b40148cfb3daa6fb61162. Resources: {'ram', 'cores', 'instances'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:23:26.190987 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Going to run 1 instances... {{(pid=116305) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:23:26.193799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:23:26.268426 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-830256ea-1ac7-4ad3-b6f1-e522669f45f5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.012449 Feb 15 04:23:26.269399 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 219/456] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 14014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:23:26.275522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:26.276392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 65a44514-834f-40e0-8a03-1f39942e705f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:26.284530 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.285477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.286608 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.287242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.322156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] HTTP exception thrown: Instance 65a44514-834f-40e0-8a03-1f39942e705f could not be found. Feb 15 04:23:26.323219 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Returning 404 to user: Instance 65a44514-834f-40e0-8a03-1f39942e705f could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:26.324270 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-39ac720e-c9a7-4ecb-b6ed-cc5ba5f1ee78 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f" status: 404 len: 111 microversion: 2.1 time: 0.053674 Feb 15 04:23:26.325613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 220/457] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:26 2022] GET /compute/v2.1/servers/65a44514-834f-40e0-8a03-1f39942e705f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:26.331642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b4d3207d-e220-4a7e-bd0a-00ab4be50970 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:26.332531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b4d3207d-e220-4a7e-bd0a-00ab4be50970 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:26.410046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4d3207d-e220-4a7e-bd0a-00ab4be50970 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:26.420446 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b4d3207d-e220-4a7e-bd0a-00ab4be50970 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1218 microversion: 2.1 time: 0.092347 Feb 15 04:23:26.430251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 221/458] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:26 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:26.430251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:26.430251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:26.434423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.434941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.438705 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.438705 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.472485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:23:26.596806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fe72ea49-afbf-4358-affc-715b670bb216 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 204 len: 0 microversion: 2.1 time: 0.172973 Feb 15 04:23:26.598167 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 222/459] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:23:26 2022] DELETE /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:26.612513 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:26.614465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:26.624087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.624996 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.626220 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.626993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.889517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:26.911497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1b268ab6-83e8-46f1-96fe-bc28a89a3168 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1513 microversion: 2.1 time: 0.304815 Feb 15 04:23:26.912545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 223/460] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:26 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1513 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:26.923212 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:26.924340 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:26.938636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.939814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:26.942781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:26.943372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.063071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:27.069758 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:23:27.072203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:23:27.073167 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:23:27.073914 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:23:27.074647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:23:27.078710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-997a25b2-dad8-4970-b589-620321b1a0f8 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1465 microversion: 2.1 time: 0.164422 Feb 15 04:23:27.079434 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 224/461] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:26 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:27.099709 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.100659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.101689 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.107325 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.151603 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Getting quotas for project b58d87f4f4ed448f8d45c85f92cf1462. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:23:27.163953 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Getting quotas for user 94835c1fe2b64e06b994878d1143ed54 and project b58d87f4f4ed448f8d45c85f92cf1462. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:23:27.192026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:23:27.197690 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47311eca-3116-4f16-8073-05d70a9a79bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:23:27.255642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-ff3ee120-c58b-4135-9b0d-dd06cc075de4 req-df32b77f-08d2-468b-b4cd-d711fe67589f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df009b7-64a5-4585-bde2-aa45e130fa97", "name": "network-vif-deleted", "tag": "3749bf1d-7b7c-4d1e-b42c-d6d16599f7be"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:27.257826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:27.257826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:23:27.283309 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-ff3ee120-c58b-4135-9b0d-dd06cc075de4 req-df32b77f-08d2-468b-b4cd-d711fe67589f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.283780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-ff3ee120-c58b-4135-9b0d-dd06cc075de4 req-df32b77f-08d2-468b-b4cd-d711fe67589f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.312241 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-ff3ee120-c58b-4135-9b0d-dd06cc075de4 req-df32b77f-08d2-468b-b4cd-d711fe67589f service nova] Creating event network-vif-deleted:3749bf1d-7b7c-4d1e-b42c-d6d16599f7be for instance 8df009b7-64a5-4585-bde2-aa45e130fa97 on hv-cinder-81610 Feb 15 04:23:27.318888 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-052866bd-7ac8-42b5-b48f-375e6f0acedc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457907 Feb 15 04:23:27.319844 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 238/462] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:23:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 04:23:27.322876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-ff3ee120-c58b-4135-9b0d-dd06cc075de4 req-df32b77f-08d2-468b-b4cd-d711fe67589f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072459 Feb 15 04:23:27.333855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c5cb7436-e43c-4df7-b414-ddc213e76187 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:27.335803 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c5cb7436-e43c-4df7-b414-ddc213e76187 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:27.337593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 225/463] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:27.427639 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5cb7436-e43c-4df7-b414-ddc213e76187 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:27.440559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:27.441310 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:27.444771 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c5cb7436-e43c-4df7-b414-ddc213e76187 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1257 microversion: 2.1 time: 0.113551 Feb 15 04:23:27.445257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 239/464] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:27 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1257 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:27.457239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.457693 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.459004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.459004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.558393 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:27.569761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-add63784-33a5-45bd-bcab-bff44a3a2830 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1214 microversion: 2.1 time: 0.134968 Feb 15 04:23:27.580634 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 226/465] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:27 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:27.954752 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:27.956815 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:27.982876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.982876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:27.982876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:27.982876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.099679 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:28.101335 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:28.116153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.116153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.116153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.116153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.185803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.186328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.187024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lazy-loading 'fault' on Instance uuid 8df009b7-64a5-4585-bde2-aa45e130fa97 {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:28.208597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:28.222658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d67c7dd8-12e1-46b7-8ceb-7fb9b0dcbf44 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1513 microversion: 2.1 time: 0.296350 Feb 15 04:23:28.223842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 240/466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:27 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:28.307463 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:28.335773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-78dd0f5f-f5f6-42d0-a95f-22494f5c7220 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 200 len: 1311 microversion: 2.1 time: 0.242178 Feb 15 04:23:28.336798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 227/467] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:28 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 1311 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:28.462270 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:28.462779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:28.470816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.472054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.472198 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.472572 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.589708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:28.590632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:28.600640 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.601524 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.602805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:28.603704 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:28.638317 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:28.649855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bc7762b5-6712-4883-aa4a-b8f25b9a8360 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1309 microversion: 2.1 time: 0.191211 Feb 15 04:23:28.652951 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 241/468] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:28 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1309 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:28.708781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:28.718999 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-496c364b-5644-4af1-8183-782f15c42155 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1276 microversion: 2.1 time: 0.135015 Feb 15 04:23:28.728513 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 228/469] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:28 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:29.239617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:29.241237 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:29.254117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.254499 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.255523 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.256136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.360106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:29.361378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: 8df009b7-64a5-4585-bde2-aa45e130fa97] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:29.385206 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.386418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.390062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.391288 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.421261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] HTTP exception thrown: Instance 8df009b7-64a5-4585-bde2-aa45e130fa97 could not be found. Feb 15 04:23:29.422862 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Returning 404 to user: Instance 8df009b7-64a5-4585-bde2-aa45e130fa97 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:29.427550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dd05e185-2e1a-4e40-9729-e5c98025de2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97" status: 404 len: 111 microversion: 2.1 time: 0.072783 Feb 15 04:23:29.427550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 229/470] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:29 2022] GET /compute/v2.1/servers/8df009b7-64a5-4585-bde2-aa45e130fa97 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:23:29.452938 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:29.457071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:29.480440 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.481273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.483514 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.484318 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.577071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:23:29.726118 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-67f216d9-8c0f-4654-9484-3ce3ff603082 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 204 len: 0 microversion: 2.1 time: 0.292421 Feb 15 04:23:29.732123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 230/471] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:23:29 2022] DELETE /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:29.740343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:29.742044 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:29.750895 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.752245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.753234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.753871 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.880052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:29.890680 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ede6af40-a458-4b32-b20b-59b1e87bcee4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1315 microversion: 2.1 time: 0.156658 Feb 15 04:23:29.891762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:29.891902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 231/472] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:29 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:29.898287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:29.899694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:29.911281 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.912259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.913645 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.914566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.914737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a035d97e-1045-41ff-b434-7dbf274c308d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1513 microversion: 2.1 time: 0.678526 Feb 15 04:23:29.927173 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 242/473] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:29 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1513 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:29.936604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:29.937729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:29.959514 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.960378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:29.961923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:29.962737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:30.219256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:30.228197 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-41192097-e940-4235-81a3-70de2be7e5b7 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.333972 Feb 15 04:23:30.229038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 232/474] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:29 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:30.595514 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:30.607708 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cb36bc32-22e3-46ae-a45f-0e35761e03ba tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.678872 Feb 15 04:23:30.619055 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 243/475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:29 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:30.909205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:30.910833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:30.937125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:30.937393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:30.945783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:30.948921 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:30.956079 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:30.965438 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:30.969338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:30.977291 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:30.978178 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:30.978634 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:31.401142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:31.411877 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e7968290-6d3c-4076-b969-46f811967566 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1315 microversion: 2.1 time: 0.506677 Feb 15 04:23:31.412824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 233/476] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:30 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:31.418174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-5b48a7bd-1ee7-4669-8f89-cb89a7a5438b req-6057033a-904d-4ccf-b8cb-a370656d4af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b17304-d7b8-4951-9026-adec2d4cc4d6", "name": "network-vif-deleted", "tag": "b6600cc5-a977-447e-babc-502e1df4a937"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:31.420385 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:31.420385 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:23:31.428595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-5b48a7bd-1ee7-4669-8f89-cb89a7a5438b req-6057033a-904d-4ccf-b8cb-a370656d4af4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:31.429497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-5b48a7bd-1ee7-4669-8f89-cb89a7a5438b req-6057033a-904d-4ccf-b8cb-a370656d4af4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:31.469811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-5b48a7bd-1ee7-4669-8f89-cb89a7a5438b req-6057033a-904d-4ccf-b8cb-a370656d4af4 service nova] Creating event network-vif-deleted:b6600cc5-a977-447e-babc-502e1df4a937 for instance 40b17304-d7b8-4951-9026-adec2d4cc4d6 on hv-cinder-81610 Feb 15 04:23:31.481955 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-5b48a7bd-1ee7-4669-8f89-cb89a7a5438b req-6057033a-904d-4ccf-b8cb-a370656d4af4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064937 Feb 15 04:23:31.487855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 234/477] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:31.493831 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:31.499096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:31.510559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:31.515130 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:31.516286 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:31.516921 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:31.771211 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:31.782800 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-23a6e830-cced-4bfa-b839-56fffd544b24 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.293100 Feb 15 04:23:31.792702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 235/478] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:31 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:31.801671 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:31.802717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:31.812099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:31.812883 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:31.814897 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:31.815659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:32.018528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:32.032170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c40a3f53-7ae9-4e7f-a7ac-0ba242f3ad99 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.242791 Feb 15 04:23:32.033506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 236/479] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:31 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:32.035676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:32.071938 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-be0819e3-08a5-4340-8a0b-c41fdac8b33d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 200 len: 1471 microversion: 2.1 time: 1.141269 Feb 15 04:23:32.083311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 244/480] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:30 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 1471 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:32.429994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:32.431366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:32.438026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:32.438964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:32.439970 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:32.440744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:32.641154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:32.651144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-69ee8065-9eba-4702-8de9-1a93909b924a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.225195 Feb 15 04:23:32.651750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 237/481] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:32 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:32.807177 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:32.813036 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:32.836806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:32.842409 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:32.851538 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:32.852730 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.052581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:33.053592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:33.087674 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:33.095035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.102297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:33.103171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.414005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:33.427411 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e0479cbb-24ea-44cf-8552-f0c267af7f06 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.379400 Feb 15 04:23:33.428672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 238/482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:33 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:33.433681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:33.434699 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: 40b17304-d7b8-4951-9026-adec2d4cc4d6] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:33.442768 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:33.444052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.445134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:33.445754 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.465148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] HTTP exception thrown: Instance 40b17304-d7b8-4951-9026-adec2d4cc4d6 could not be found. Feb 15 04:23:33.466683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Returning 404 to user: Instance 40b17304-d7b8-4951-9026-adec2d4cc4d6 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:33.467741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a6623170-a56c-4c74-b2b3-3cdaee7e7cdb tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6" status: 404 len: 111 microversion: 2.1 time: 0.037814 Feb 15 04:23:33.469629 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 239/483] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:33 2022] GET /compute/v2.1/servers/40b17304-d7b8-4951-9026-adec2d4cc4d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:33.669982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:33.670811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:33.684010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:33.684182 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.685753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:33.688438 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:33.962278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:33.973442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e826f5d5-8e1e-4e5b-903f-e1a597185992 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.308754 Feb 15 04:23:33.987828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 240/484] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:33 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:34.017298 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:34.037901 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-654715c5-df7c-45cd-a2a8-f760eacc612b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 1.237280 Feb 15 04:23:34.040954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 245/485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:32 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:34.452649 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:34.453301 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:34.461632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.462090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:34.462915 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.463344 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:34.472936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-b85493ff-5cf8-4606-b2f9-07d021179de6 req-46104822-28ab-4995-ab97-d959e038023f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf316805-ef34-4e31-9a87-59a0b8c0e09f", "tag": "21effa65-6f1f-4199-a6a4-698a3f85a8cf"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:34.475981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:34.475981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:23:34.488541 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b85493ff-5cf8-4606-b2f9-07d021179de6 req-46104822-28ab-4995-ab97-d959e038023f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.489643 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b85493ff-5cf8-4606-b2f9-07d021179de6 req-46104822-28ab-4995-ab97-d959e038023f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:34.527216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-b85493ff-5cf8-4606-b2f9-07d021179de6 req-46104822-28ab-4995-ab97-d959e038023f service nova] Creating event network-changed:21effa65-6f1f-4199-a6a4-698a3f85a8cf for instance cf316805-ef34-4e31-9a87-59a0b8c0e09f on hv-cinder-81610 Feb 15 04:23:34.553126 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-b85493ff-5cf8-4606-b2f9-07d021179de6 req-46104822-28ab-4995-ab97-d959e038023f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072036 Feb 15 04:23:34.555389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 246/486] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:34.735982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:34.753340 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0bf4bf72-5bb1-4db5-829e-2ba74d636413 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.305973 Feb 15 04:23:34.763602 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 241/487] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:34 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:34.779008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:34.780041 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:34.789259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.790154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:34.791387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.792276 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:34.837785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:23:34.951699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-10e06ce0-4458-4ad8-9156-81549d7f4faa tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 204 len: 0 microversion: 2.1 time: 0.178625 Feb 15 04:23:34.952439 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 247/488] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:23:34 2022] DELETE /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:34.962798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:34.963599 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:34.973619 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.974416 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:34.975843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:34.976476 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.015837 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:35.021760 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:35.031633 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.032580 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.034481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.035127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.208188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:35.220011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c08ee308-9d66-44f1-aa6b-bad9f4c27446 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.263267 Feb 15 04:23:35.224954 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 242/489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:34 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:35.227971 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:35.228694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:35.238021 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.238625 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.239278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.239710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.289222 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:35.300021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-49e3ad3f-5a0f-45ea-907c-d781a407f928 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.305454 Feb 15 04:23:35.310441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 248/490] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:34 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:35.437843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:35.448936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f0436924-9a01-49d2-af71-889650f63663 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.225791 Feb 15 04:23:35.450045 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 243/491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:35 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:35.771599 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:35.772559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:35.779513 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.780316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.781476 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.782086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.877986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:35.878765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:35.886285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.887443 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.890032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:35.890638 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:35.963594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lazy-loading 'flavor' on Instance uuid 6bfde5a4-3494-4123-b1d1-aa408427983a {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:36.086343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.098632 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1304b43e-219f-4d51-8e19-2e1f5702ec34 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.330981 Feb 15 04:23:36.099491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 249/492] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:35 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:36.241493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:36.242368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:36.250817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.251428 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.252229 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.252669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.284194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9f3e1811-bdc9-427a-9d28-3c3313f6792d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/action" status: 202 len: 0 microversion: 2.20 time: 0.409873 Feb 15 04:23:36.285546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 244/493] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Feb 15 04:23:35 2022] POST /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:23:36.294588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:36.295620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:36.302510 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.303216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.304172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.304600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.442647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.453206 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f1b11ffb-ff06-4e94-bb43-0fec92cb0319 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.217147 Feb 15 04:23:36.454093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 250/494] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:36 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:36.459445 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:36.460058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:36.471228 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.471964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.472966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.473573 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.483272 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.492580 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.494493 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.496261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2fccc0a5-ae04-41a3-8439-03019f9e484c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.206420 Feb 15 04:23:36.517276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 245/495] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:36 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:36.522077 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:36.527435 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:36.534208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.534743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.536554 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.537120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.686051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.698783 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4e6be3a3-7e39-4721-a770-ba99fab7c8ea tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.243190 Feb 15 04:23:36.699432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 251/496] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:36 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:36.704771 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-60c410a9-9793-4a42-bbb0-f789fdb00214 req-8defb18e-2692-4b25-8158-b373e205a7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:36.706577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:36.706577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:23:36.714525 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-60c410a9-9793-4a42-bbb0-f789fdb00214 req-8defb18e-2692-4b25-8158-b373e205a7c7 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:36.714957 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-60c410a9-9793-4a42-bbb0-f789fdb00214 req-8defb18e-2692-4b25-8158-b373e205a7c7 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:36.742113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-60c410a9-9793-4a42-bbb0-f789fdb00214 req-8defb18e-2692-4b25-8158-b373e205a7c7 service nova] Creating event network-changed:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:23:36.749117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-60c410a9-9793-4a42-bbb0-f789fdb00214 req-8defb18e-2692-4b25-8158-b373e205a7c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048038 Feb 15 04:23:36.752756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 252/497] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:36.772656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:36.782214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-708aec92-a35c-4c1a-8bf1-e56c226c888b tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.263708 Feb 15 04:23:36.782819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 246/498] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:36 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:37.122330 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:37.123659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:37.134660 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.135450 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.136929 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.138291 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.390991 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:37.404829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-eebba61e-b51c-420b-a6d7-7449df906e24 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.290895 Feb 15 04:23:37.406506 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 253/499] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:37 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:37.478762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:37.479437 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:37.492979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.493882 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.496159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.497643 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.517419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:37.518252 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:37.530925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.532018 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.533103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.538049 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.768576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:37.777980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:37.780647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:37.781809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9d7ecb8d-adfc-4bad-840a-d8bc705f8e79 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.268327 Feb 15 04:23:37.785055 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 254/500] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:37 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:37.792269 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:37.793486 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:37.801684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.802428 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.803231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.803664 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.829156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:37.837889 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fc172819-43d6-41dc-b107-6826d80c5b65 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.363421 Feb 15 04:23:37.838885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 247/501] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:37 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:37.844664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:37.845627 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:37.852178 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.853014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:37.854037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:37.854573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:38.017500 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:38.025343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0ca557ea-faa9-4770-b72b-38eb0c8ea91a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.241334 Feb 15 04:23:38.025936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 255/502] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:37 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:38.041437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bfebf58-7623-4840-828d-881ed2c56550"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:38.042944 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:38.060129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:38.061276 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:38.062786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:38.063418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:38.110552 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:38.118399 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f2c235ed-5ea1-4e99-85ab-ebceef328a2a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.278156 Feb 15 04:23:38.118985 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 248/503] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:37 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:38.423564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:38.424261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:38.433393 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:38.434091 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:38.435556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:38.436192 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:38.647063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:38.657168 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a8657636-6534-4f8d-895c-5d885fde21e6 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.238542 Feb 15 04:23:38.658207 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 249/504] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:38 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:38.806396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:38.808010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:38.821470 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:38.822644 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:38.824507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:38.825908 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.212536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:39.222030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:39.229255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:39.233769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-89a8b7fd-5725-403e-90be-44af38712b68 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.435067 Feb 15 04:23:39.235499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 250/505] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:38 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:39.240209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:39.240848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:39.255228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.255616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.256483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.256950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.444684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:39.454626 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0d463f76-132e-4855-a5ff-b664fdf2e334 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.215902 Feb 15 04:23:39.455150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 251/506] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:39 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:39.460634 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:39.461570 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:39.469710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.469710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.470784 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.471628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.670630 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:39.686803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a20800dd-483e-4d88-86d7-cf92238efd5c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.230563 Feb 15 04:23:39.687382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 252/507] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:39 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:39.693239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:39.702597 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:39.709661 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.710110 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.711063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.712089 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.952762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:39.971985 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-39718b91-5448-4de3-b5cc-25a32495f93d tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.281705 Feb 15 04:23:39.977354 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 253/508] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:39 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:39.984745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:39.985879 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:39.992684 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.993298 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:39.994119 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:39.994559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.213283 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:40.224550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-07497fc3-f292-4079-aa27-e744071ee10b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.245302 Feb 15 04:23:40.225560 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 254/509] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:39 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:40.253488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:40.254126 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:40.260654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:40.261209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.262159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:40.263127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.441193 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:40.449654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:40.452184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:40.453918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-820a1b3e-54d6-4231-a1f0-c239f0d11e8f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.204483 Feb 15 04:23:40.454525 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 255/510] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:40 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:40.472678 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:40.473337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:40.486096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:40.493766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.495721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:40.496740 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.658166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:40.668094 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-45b0bfaf-bf27-403a-bdf2-3660170d8d77 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.199685 Feb 15 04:23:40.668722 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 256/511] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:40 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:40.704330 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:40.705127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:40.711189 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:40.711642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.712444 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:40.712885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:40.897312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:40.905564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0ea09f91-9f51-44a6-b55d-344f5eb669c0 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.205345 Feb 15 04:23:40.906149 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 257/512] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:40 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:40.998338 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:40.998616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:41.004942 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.005394 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.006177 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.006611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.172295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:41.186451 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-27fa0df9-7a3c-49d5-80d8-f063d6b2d955 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.192873 Feb 15 04:23:41.197679 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 258/513] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:40 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:41.243170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:41.243940 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:41.252130 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.252966 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.254184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.255020 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.439877 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:41.449141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-51cf1be0-dabf-4a74-b252-9c6f7231422c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.209862 Feb 15 04:23:41.449730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 259/514] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:41 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:41.488738 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:41.492331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:41.501850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.502254 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.502979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.503418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.729924 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:41.749089 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:41.751529 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:41.752878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-efe37540-3606-4c7c-8013-3a5c9917c1b8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.269470 Feb 15 04:23:41.753419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 260/515] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:41 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:41.757960 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:41.758577 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:41.785998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.787585 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:41.789397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:41.790294 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.003695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.011371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7793c59a-2af0-4c62-a0af-d51f8e97f2b0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.256917 Feb 15 04:23:42.011952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 261/516] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:41 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:42.016467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:42.017097 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:42.024551 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.025037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.025820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.026254 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.193835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.202517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2455d454-cea9-4d1d-a012-33be0d759844 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.189446 Feb 15 04:23:42.203110 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 262/517] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:42 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:42.210387 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:42.211157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:42.219062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.219820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.220801 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.221398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.381820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.391331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-35d14f7f-3c44-41f7-91ea-d4e45ca44b59 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.185215 Feb 15 04:23:42.392095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 263/518] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:42 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:42.467916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:42.468600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:42.474908 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.475355 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.476148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.476733 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.632646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.642522 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-49dcf4bc-a003-481c-98cb-f979e0486f9b tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.178950 Feb 15 04:23:42.645649 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 264/519] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:42 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:42.773978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:42.775090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:42.783963 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.784654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.785276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:42.785707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:42.940712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.951319 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.954323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:42.955998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-34e4ec6e-52d6-400b-86fb-1e68990336d7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.187394 Feb 15 04:23:42.969499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 265/520] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:42 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:43.027655 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:43.028788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:43.035349 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.035876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.036700 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.037188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.187512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:43.195977 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6f991a9f-ce18-4221-83f5-bf9abb1abd02 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.171980 Feb 15 04:23:43.196956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 266/521] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:43 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:43.221191 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:43.221805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:43.227975 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.228415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.229234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.229659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.406030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:43.415336 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-05d71407-8939-4c4c-b297-5c2fa33c6b8b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.198103 Feb 15 04:23:43.415958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 267/522] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:43 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:43.421688 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:43.422295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:43.428889 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.429499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.430600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.431233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.629261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:43.638242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0b94512a-12cd-498a-9c31-bf06655414fd tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.220191 Feb 15 04:23:43.638998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 268/523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:43 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:43.667723 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:43.668257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:43.675367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.675838 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.676648 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.677121 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.853500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:43.867797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5e9e135a-c8b6-4669-abd1-d7cf3296355e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.203446 Feb 15 04:23:43.868719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 269/524] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:43 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:43.977092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:43.977710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:43.984660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.985159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:43.985961 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:43.986401 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.178333 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:44.187167 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:44.188682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:44.190102 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f1aa09a1-ce4c-4ad4-8331-a1f702315026 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.216656 Feb 15 04:23:44.190721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 270/525] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:43 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:44.214956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:44.216771 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:44.223998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.224466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.225312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.226066 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.375263 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:44.382826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-862b519f-a441-42b3-8a8c-e1a123527af0 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.172847 Feb 15 04:23:44.383404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 271/526] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:44 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:44.432575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:44.433210 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:44.439797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.440244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.441067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.441495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.591161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:44.598550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3e5aa172-1275-416a-b7da-e081396479ab tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.169608 Feb 15 04:23:44.599123 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 272/527] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:44 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:44.656113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:44.656715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:44.662930 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.663375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.664161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.664589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.816251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:44.824083 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ab2c0868-4507-4432-aafa-82b080e70ca1 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.171864 Feb 15 04:23:44.824665 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 273/528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:44 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:44.886176 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:44.886860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:44.893007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.893457 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:44.894282 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:44.894716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.042960 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:45.051346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-cec556cc-48fd-47c8-aeef-e20d28dedc4a tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.169150 Feb 15 04:23:45.051933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 274/529] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:44 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:45.211037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:45.212149 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:45.220591 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.220591 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.221632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.222236 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.388875 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:45.398491 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:45.400157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:45.401478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b4316e95-ec77-44cd-a5c6-b8aefdd715dc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.195545 Feb 15 04:23:45.402145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 275/530] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:45 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:45.406884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:45.407659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:45.414671 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.415230 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.416137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.416686 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.574371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:45.582109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-231de956-8998-4ca2-94f4-0c698b32253c tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.178832 Feb 15 04:23:45.582715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 276/531] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:45 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:45.616157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:45.616912 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:45.624215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.624664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.625498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.625935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.780255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:45.788046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8582d065-ffdc-43c7-b1e2-d7a1d7db2bac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.175572 Feb 15 04:23:45.788633 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 277/532] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:45 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:45.844742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:45.846172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:45.856872 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.857712 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:45.859052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:45.859556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.026368 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:46.036303 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d7c78522-4dea-4059-855f-31f7e283c604 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.198041 Feb 15 04:23:46.036950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 278/533] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:45 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:46.069638 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:46.070244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:46.087917 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.088476 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.090328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.091992 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.274864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:46.283806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-51296721-f164-42fd-8a92-9c834744ed85 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.217833 Feb 15 04:23:46.293051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 279/534] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:46 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:46.426320 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:46.427078 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:46.443964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.445049 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.446824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.448185 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.479286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4ea9131c-9b75-4a19-a6f7-30170efdd57c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.441975 Feb 15 04:23:46.480700 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 256/535] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:23:38 2022] POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-volume_attachments => generated 194 bytes in 8444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:46.601821 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:46.603551 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:46.616283 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.616769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.620190 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.620649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.734563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:46.746455 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:46.754239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:46.755469 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a5c6cf3f-c1f8-4f8b-8c6d-637ee5cebced tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.335950 Feb 15 04:23:46.765132 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 280/536] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:46 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:46.807091 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:46.808511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:46.817423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.818773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:46.819724 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:46.820322 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.071350 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:47.086121 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bd06dfa2-b558-4da5-8d1a-bcede7c908b1 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.283691 Feb 15 04:23:47.087071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 281/537] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:46 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:47.092218 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:47.093435 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:47.104056 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:47.105256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.108944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:47.109610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.135559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:47.156469 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9fdacb8f-b945-49c0-adc5-a71e16cada16 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.559991 Feb 15 04:23:47.169588 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 257/538] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:46 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:47.299917 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:47.300884 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:47.307223 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:47.308004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.309049 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:47.310433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.318292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:47.333852 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e35fc93b-c46f-484d-9d7c-17bce4f7ad5a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.245201 Feb 15 04:23:47.335124 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 282/539] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:47 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:47.775267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:47.776431 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:47.784666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:47.785157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.786418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:47.787023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:47.991928 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.003102 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.004862 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.006209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6ff40755-ff04-4a31-9cbd-8c1f24f8cdfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.235543 Feb 15 04:23:48.007024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 283/540] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:47 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:48.111886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.114331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:48.116145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:48.127601 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0a8480f5-1ffc-460f-97fe-e6f426f04059 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.830705 Feb 15 04:23:48.128702 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 258/541] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:47 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:48.140355 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:48.140355 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:48.141078 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:48.141545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:48.175503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:48.175503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:48.197915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:48.197915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:48.197915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:48.197915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:48.330129 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.342884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f48765b0-287e-4b03-ac2d-bdf209bf546a tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.234814 Feb 15 04:23:48.343568 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 284/542] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:48 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:48.353742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:48.354363 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:48.361746 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:48.362487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:48.363481 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:48.363918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:48.569564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.579087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-97a4adec-1cc5-40e3-b43f-7bff547d3b19 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.229254 Feb 15 04:23:48.587926 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 285/543] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:48 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:48.612609 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:48.623291 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f692a73d-6db7-43b4-a750-c255637a8e8a tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1514 microversion: 2.1 time: 0.451891 Feb 15 04:23:48.624979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 259/544] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:48 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:49.026278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:49.026886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:49.035137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.035581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.036374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.036885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.145480 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:49.146179 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:49.154367 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.155167 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.156284 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.156955 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.268320 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.279776 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.282039 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.283687 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-76dcfbe6-eeb9-47ea-b377-fb112e49c979 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.261106 Feb 15 04:23:49.284375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 286/545] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:49 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:49.290433 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-56daa7f7-cefa-4fbd-9189-5fb4688f440f req-5f744ce5-b8c6-4f0c-b58b-ffb28d2133fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf", "name": "network-vif-deleted", "tag": "e5000b8c-e731-4109-b8ae-a57706444763"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:49.292835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:49.292835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:23:49.304119 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-56daa7f7-cefa-4fbd-9189-5fb4688f440f req-5f744ce5-b8c6-4f0c-b58b-ffb28d2133fb service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.306143 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-56daa7f7-cefa-4fbd-9189-5fb4688f440f req-5f744ce5-b8c6-4f0c-b58b-ffb28d2133fb service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.329554 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-56daa7f7-cefa-4fbd-9189-5fb4688f440f req-5f744ce5-b8c6-4f0c-b58b-ffb28d2133fb service nova] Creating event network-vif-deleted:e5000b8c-e731-4109-b8ae-a57706444763 for instance f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf on hv-cinder-81610 Feb 15 04:23:49.335982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-56daa7f7-cefa-4fbd-9189-5fb4688f440f req-5f744ce5-b8c6-4f0c-b58b-ffb28d2133fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050117 Feb 15 04:23:49.336671 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 287/546] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:49.382180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:49.383483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:49.397130 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.397833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.399259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.400064 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.441915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.452051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5e5ab9ea-53ae-44f9-9b90-fdfd22f382aa tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.310436 Feb 15 04:23:49.452857 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 260/547] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:49 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:49.597834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:49.598639 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:49.609277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.610192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.611788 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.612611 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.617739 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.629815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f771258d-fe41-4b96-85c1-45e9a2eb2bf8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.256686 Feb 15 04:23:49.630780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 288/548] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:49 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:49.649729 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:49.650581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:49.660111 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.660714 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.664511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.665292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.731702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:49.732941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:49.733804 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lazy-loading 'fault' on Instance uuid f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:49.841439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f544b022f84fb291d0794dca05788d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7002e2df35463c9128baa00359cd9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.844880 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:49.852312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-183b8646-4b38-43fb-a0f5-7739f9083689 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.258963 Feb 15 04:23:49.852916 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 261/549] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:49 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:49.854590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ebfe5c9b-e812-4875-b2da-ce196380168d tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 200 len: 1307 microversion: 2.1 time: 0.208810 Feb 15 04:23:49.855641 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 289/550] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:49 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:50.316927 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:50.317609 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:50.324380 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.324994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.326718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.327005 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.480196 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:50.482404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:50.490379 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.491102 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.492049 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.492600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.514667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:50.527547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:50.529550 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:50.531008 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b311add2-752a-4323-bfb2-7955e7a5b28b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.218267 Feb 15 04:23:50.531650 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 262/551] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:50 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:50.650721 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:50.651479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:50.659205 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.659708 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.660530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.661224 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.689605 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:50.703193 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f603c889-665c-4dfd-9a7d-3a3f99b7f5eb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.227756 Feb 15 04:23:50.704825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 290/552] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:50 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:50.874356 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:50.875941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:50.888426 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.889761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.891855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.892685 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.910847 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:50.921719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b290f93d-5b14-4f98-9446-7eba5d98875d tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.274391 Feb 15 04:23:50.922712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 263/553] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:50 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:50.928119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:50.929126 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] [instance: f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:50.936993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.937461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.938342 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:50.938862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:50.969737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] HTTP exception thrown: Instance f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf could not be found. Feb 15 04:23:50.970600 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] Returning 404 to user: Instance f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:50.971795 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9c8b581e-fe29-4771-b7a7-55693e689f11 tempest-AttachVolumeNegativeTest-300826860 tempest-AttachVolumeNegativeTest-300826860-project] 10.222.0.45 "GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf" status: 404 len: 111 microversion: 2.1 time: 0.047691 Feb 15 04:23:50.972693 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 264/554] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:50 2022] GET /compute/v2.1/servers/f7e6b34f-7741-40e3-8f0d-379e3f1c7dbf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:51.098506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:51.109908 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-14c20347-5487-4351-bdcd-f02cc7d198c4 tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1523 microversion: 2.1 time: 0.242438 Feb 15 04:23:51.110840 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 291/555] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:50 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:51.566811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:51.570312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:51.590157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.590677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:51.591498 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.592127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:51.652241 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-7812ede8-70e3-4923-9807-d1574ea7fcab req-c46bfcf9-8c46-4557-aed5-78a75baeef48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca522ac8-8430-4ab4-aa43-9de561155e52", "name": "network-vif-deleted", "tag": "3de6a7fb-53a5-40a9-af0f-ab012f0726c6"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:51.656497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:51.656497 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:23:51.670441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-7812ede8-70e3-4923-9807-d1574ea7fcab req-c46bfcf9-8c46-4557-aed5-78a75baeef48 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.671598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-7812ede8-70e3-4923-9807-d1574ea7fcab req-c46bfcf9-8c46-4557-aed5-78a75baeef48 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:51.697948 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-7812ede8-70e3-4923-9807-d1574ea7fcab req-c46bfcf9-8c46-4557-aed5-78a75baeef48 service nova] Creating event network-vif-deleted:3de6a7fb-53a5-40a9-af0f-ab012f0726c6 for instance ca522ac8-8430-4ab4-aa43-9de561155e52 on hv-cinder-81610 Feb 15 04:23:51.708468 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-7812ede8-70e3-4923-9807-d1574ea7fcab req-c46bfcf9-8c46-4557-aed5-78a75baeef48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064268 Feb 15 04:23:51.710076 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 292/556] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:23:51.734825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:51.736019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:51.745822 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.748443 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:51.751252 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.752339 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:51.856972 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:51.871493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:51.875494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:51.876943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5e3af87b-af68-4324-8b3a-8f9a12f6247e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.320598 Feb 15 04:23:51.878086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 265/557] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:51 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:51.942122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:51.943243 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:51.960861 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.961719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:51.963747 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:51.966898 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:52.002423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:52.012110 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a32e5723-3f6e-401f-bc84-a496beaf99da tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.291927 Feb 15 04:23:52.013335 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 293/558] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:51 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:52.136465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:52.138395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:52.150517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:52.151766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:52.153789 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:52.155880 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:52.225560 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:52.235743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:52.236843 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:52.237956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lazy-loading 'fault' on Instance uuid ca522ac8-8430-4ab4-aa43-9de561155e52 {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:23:52.238567 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7c0536a7-3691-48fb-942c-115d7e914b0c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.302197 Feb 15 04:23:52.250329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 266/559] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:51 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:52.324450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec544bab4b94d5e95eaf793afc0138c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bc531651b748a791dbbbc11ee10adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:52.337877 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-26a73d13-f494-44a2-84f0-12ad84aaa54c tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 200 len: 1312 microversion: 2.1 time: 0.209958 Feb 15 04:23:52.339307 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 294/560] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:52 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:52.911407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:52.912333 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:52.923883 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:52.924553 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:52.926202 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:52.927083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.044539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:53.048094 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:53.079113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:53.080138 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.081501 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:53.082142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.199867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:53.214079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:53.216119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:53.218265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1489a826-6c0c-41c9-bac0-1f7f0841f905 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.311142 Feb 15 04:23:53.222888 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 267/561] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:52 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:53.302482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:53.303908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:53.332877 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:53.333158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.344364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:53.344977 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.504351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:53.513349 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a2cdc1dc-10df-424d-9988-3f2085559cc5 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.476422 Feb 15 04:23:53.513951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 295/562] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:53 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:53.521672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:53.522634 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] [instance: ca522ac8-8430-4ab4-aa43-9de561155e52] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:53.536705 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:53.537949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.539147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:53.539813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:53.559088 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] HTTP exception thrown: Instance ca522ac8-8430-4ab4-aa43-9de561155e52 could not be found. Feb 15 04:23:53.560545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] Returning 404 to user: Instance ca522ac8-8430-4ab4-aa43-9de561155e52 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:23:53.561682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1311540d-e848-4c04-bdaa-43d5c89fc69a tempest-ServerRescueNegativeTestJSON-1490134519 tempest-ServerRescueNegativeTestJSON-1490134519-project] 10.222.0.45 "GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52" status: 404 len: 111 microversion: 2.1 time: 0.044336 Feb 15 04:23:53.562467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 296/563] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:53 2022] GET /compute/v2.1/servers/ca522ac8-8430-4ab4-aa43-9de561155e52 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:53.650090 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:53.661775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-037077fe-a321-49a6-8d76-05f5ebd85778 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.399570 Feb 15 04:23:53.662816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 268/564] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:53 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:54.247701 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-db69ad5b-ac80-4135-968a-05480ce57c8f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:54.252195 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:54.252815 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:54.257594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db69ad5b-ac80-4135-968a-05480ce57c8f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.258302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db69ad5b-ac80-4135-968a-05480ce57c8f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.259679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.267337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.268723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.271580 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.344429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-db69ad5b-ac80-4135-968a-05480ce57c8f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Going to try to stop instance {{(pid=116305) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 15 04:23:54.410261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-db69ad5b-ac80-4135-968a-05480ce57c8f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action" status: 202 len: 0 microversion: 2.1 time: 0.169201 Feb 15 04:23:54.413030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 297/565] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:23:54 2022] POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:23:54.445188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:54.446369 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:54.456968 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.458474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.460797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.462016 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.488942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:54.502393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:54.504242 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:54.506563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1d335f44-fa5e-4e22-aa3b-e8e8fbbafc95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.257584 Feb 15 04:23:54.507461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 269/566] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:54 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:54.531037 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:54.531775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:54.538684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.539329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.540381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.540929 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.728003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:54.743259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e30b4890-5d07-417c-97ac-7564761165e7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.216208 Feb 15 04:23:54.746052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 270/567] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:54 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:23:54.756885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:54.758224 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:54.773564 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.774610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.776505 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:54.777278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:54.796694 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:54.806510 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-18ec75e1-33de-40d2-a59c-a7760ca2b23c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.376086 Feb 15 04:23:54.807144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 298/568] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:54 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:54.956212 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:54.967447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7ab6c634-291c-4ef3-b598-2e741f901b8e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.218163 Feb 15 04:23:54.968031 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 271/569] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:54 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:55.535664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:55.535664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:55.548609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:55.549378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:55.550840 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:55.551602 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:55.776412 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:55.778285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:55.792480 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:55.793969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:55.797074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:55.797902 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:55.906578 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:55.917987 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:55.935850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:55.937789 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d40b77ee-826c-4b9b-af4e-fb9e8c897eb1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.413872 Feb 15 04:23:55.941404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 299/570] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:55 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:55.984471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:55.985441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:55.994119 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:55.994839 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:55.996180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:55.997487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:56.019313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:56.027549 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-eef37c55-b608-4788-b1f1-9c54eac54f58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.266119 Feb 15 04:23:56.028265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 272/571] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:55 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:56.033098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:56.034012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:56.042742 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:56.043718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:56.044730 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:56.045200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:56.235313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:56.243310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ccaf5a65-aff6-4640-995e-729babc8dd3e tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.213735 Feb 15 04:23:56.243937 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 273/572] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:56 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:56.344155 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:56.355539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-975412b5-e09f-46bb-aeac-9442155fda1a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.396697 Feb 15 04:23:56.357603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 300/573] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:55 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:56.914162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-7a97a5c3-89ed-4efd-ba79-0c629e0a7ad0 req-4aa013f8-1b65-4d81-87cb-9c879e62d63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf316805-ef34-4e31-9a87-59a0b8c0e09f", "name": "network-vif-plugged", "status": "completed", "tag": "21effa65-6f1f-4199-a6a4-698a3f85a8cf"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:56.915994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:56.915994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:23:56.925107 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7a97a5c3-89ed-4efd-ba79-0c629e0a7ad0 req-4aa013f8-1b65-4d81-87cb-9c879e62d63f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:56.926398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7a97a5c3-89ed-4efd-ba79-0c629e0a7ad0 req-4aa013f8-1b65-4d81-87cb-9c879e62d63f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:56.942217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-7a97a5c3-89ed-4efd-ba79-0c629e0a7ad0 req-4aa013f8-1b65-4d81-87cb-9c879e62d63f service nova] Creating event network-vif-plugged:21effa65-6f1f-4199-a6a4-698a3f85a8cf for instance cf316805-ef34-4e31-9a87-59a0b8c0e09f on hv-cinder-81610 Feb 15 04:23:56.949547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-7a97a5c3-89ed-4efd-ba79-0c629e0a7ad0 req-4aa013f8-1b65-4d81-87cb-9c879e62d63f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038886 Feb 15 04:23:56.950862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 274/574] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:23:56.986890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:56.987863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:57.004802 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.006797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.011473 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.014086 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.054735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:57.060530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:57.073437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.075463 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.079142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.080995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.422017 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:57.436236 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b05e1af7-8d80-44b5-b2d9-307c1c5189dc tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.392858 Feb 15 04:23:57.437007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 275/575] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:57 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:57.443204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:57.444513 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:57.455886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.456817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.458341 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.459242 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.478934 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:57.491461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:57.493218 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:57.495041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0fafbea0-dff8-4384-91f9-5a088cdb7f5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.514107 Feb 15 04:23:57.496055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 301/576] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:56 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:23:57.503050 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:57.504221 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:57.511715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.512756 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.513869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:57.515114 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:57.658340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:57.667395 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-344d4bd5-09ad-4093-bd1a-12185b61bfec tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.228700 Feb 15 04:23:57.669905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 276/577] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:57 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:58.177656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:58.187142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4d9360a9-05ad-414f-9ada-1dcd377d0513 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.687884 Feb 15 04:23:58.188058 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 302/578] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:57 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:58.470849 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:58.474699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:58.494095 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.495828 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:58.498603 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.499674 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:58.528939 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:58.532698 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:58.555517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.556323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:58.558036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.559092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:58.827517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:58.850865 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:58.854087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:58.857504 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-86a0aa33-1083-4224-954d-fff8a017d79f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.335696 Feb 15 04:23:58.861978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 303/579] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:58 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:23:58.870845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:58.872458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:58.884663 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.885495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:58.887474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.888271 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:58.946436 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:58.961325 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1c23ac14-54cc-40c4-bfb4-f7d736c8b814 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1318 microversion: 2.1 time: 0.509265 Feb 15 04:23:58.969181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 277/580] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:58 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:58.974663 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-aa354213-2989-4241-88e3-ae77db9f1edf req-be5f6a8d-6a59-44f7-833e-345459ece9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "name": "network-vif-plugged", "status": "completed", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:23:58.976360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:23:58.976360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:23:58.985724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-aa354213-2989-4241-88e3-ae77db9f1edf req-be5f6a8d-6a59-44f7-833e-345459ece9cd service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:58.986604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-aa354213-2989-4241-88e3-ae77db9f1edf req-be5f6a8d-6a59-44f7-833e-345459ece9cd service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:59.005081 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-aa354213-2989-4241-88e3-ae77db9f1edf req-be5f6a8d-6a59-44f7-833e-345459ece9cd service nova] Creating event network-vif-plugged:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:23:59.013033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-aa354213-2989-4241-88e3-ae77db9f1edf req-be5f6a8d-6a59-44f7-833e-345459ece9cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041248 Feb 15 04:23:59.015068 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 278/581] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:23:59.126745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:59.157966 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5d5d654f-2396-42e8-a9c0-49ced462caac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.291523 Feb 15 04:23:59.167853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 304/582] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:58 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:59.209884 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:59.211743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:59.224025 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:59.225132 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:59.226812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:59.227573 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:59.511657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:23:59.521712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5c7a6422-b534-44ea-9c6c-36d81084165f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.319641 Feb 15 04:23:59.522540 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 279/583] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:59 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:23:59.878402 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:59.879410 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:23:59.889832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:59.890650 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:59.891818 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:23:59.892529 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:23:59.987751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:23:59.990863 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:00.006888 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:00.008106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:00.010518 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:00.011855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:00.081506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:00.099408 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:00.104023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:00.108276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3f2bb546-8f40-49f3-89b0-f2f0d2d5dcad tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.234185 Feb 15 04:24:00.125587 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 305/584] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:23:59 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:00.176664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:00.178133 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:00.185486 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:00.186112 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:00.188398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:00.189134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:00.236430 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:00.246344 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bafffd96-a048-4cc2-966c-c4c529ef391e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1507 microversion: 2.1 time: 0.270102 Feb 15 04:24:00.247673 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 280/585] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:23:59 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:00.382291 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:00.395081 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-65af6fb6-79ed-4b66-be91-df63fedff94b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1357 microversion: 2.1 time: 0.221947 Feb 15 04:24:00.404944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 306/586] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:00 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:00.540343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:00.541129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:00.548410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:00.548983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:00.550926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:00.551035 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:00.776644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:00.788494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b1786941-77dc-44f8-9a2b-53c32a5a421f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.252145 Feb 15 04:24:00.797144 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 281/587] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:00 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:01.141607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:01.142275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:01.150922 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.150922 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.151437 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.151974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.333476 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:01.344803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:01.347398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:01.349797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6db01fdd-b903-41e1-ba9c-b62bc93d9399 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.212800 Feb 15 04:24:01.350976 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 307/588] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:01 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:01.419142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:01.419915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:01.426696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.427515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.428531 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.428995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.590571 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:01.599838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-14c6a6dd-f012-4934-b847-c3df1e951ac8 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1547 microversion: 2.1 time: 0.185567 Feb 15 04:24:01.600964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 282/589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:01 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:01.616246 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:01.623116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:01.631311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.632630 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.634176 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.634839 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.805819 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:01.806737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:01.815338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.815796 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.817477 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.818134 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.821180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:01.829862 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-db8c673f-777c-4db9-8f8c-5cde38fa55bf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1547 microversion: 2.1 time: 0.217003 Feb 15 04:24:01.830441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 308/590] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:01 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1547 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:01.848409 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:01.852760 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:24:01.852760 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:24:01.857191 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:01.858189 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Searching by: {'deleted': False, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462'} {{(pid=116305) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 15 04:24:01.865709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.866166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:01.867273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:01.867995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:02.002454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.multi_cell_list [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116305) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 15 04:24:02.063186 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:02.074081 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-edd62794-7b93-4a6e-bc93-81f93197ab81 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.270578 Feb 15 04:24:02.077244 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 283/591] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:01 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:02.143534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-227dd830-0a61-4686-b91a-0c81ccbf60e4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.299197 Feb 15 04:24:02.144297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 309/592] 10.222.0.45 () {58 vars in 1124 bytes} [Tue Feb 15 04:24:01 2022] GET /compute/v2.1/servers => generated 342 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:02.156494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:02.157140 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:02.178272 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:02.178966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:02.180410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:02.181239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:02.373753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:02.374371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:02.389321 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:02.389321 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:02.391175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:02.393062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:02.402081 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:02.413321 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e1d49958-6f1e-4e6f-8d44-db62c5b880df tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1547 microversion: 2.1 time: 0.260882 Feb 15 04:24:02.414293 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 284/593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:02 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1547 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:02.652584 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:02.665004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:02.666530 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:02.668881 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a6df1289-7e78-4d5b-a662-81645bc500ce tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.301732 Feb 15 04:24:02.680295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 310/594] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:02 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:03.093414 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:03.094057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:03.100792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:03.101667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:03.102456 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:03.103301 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:03.314219 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:03.341380 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4dc77054-5ff3-4127-84d9-a8ecebecdd43 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.251862 Feb 15 04:24:03.342655 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 285/595] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:03 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:03.688145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:03.689741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:03.699831 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:03.703389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:03.704947 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:03.714492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:03.966883 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:03.988358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:03.991407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:03.993730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-92341ccd-c221-4982-a049-ca381fec77cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.309786 Feb 15 04:24:04.007135 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 311/596] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:03 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:04.201566 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40a211b4-e2ae-4f8a-885b-ace6f64272e6"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:04.204043 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:04.213556 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:04.214782 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:04.216448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:04.217436 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:04.364187 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:04.366600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:04.379143 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:04.380582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:04.382595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:04.384422 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:04.673291 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:04.690252 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-57522e95-6798-41a9-8eb0-4b7dc6ac1283 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.332991 Feb 15 04:24:04.693004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 312/597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:04 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:04.713372 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c829e649-2391-437a-9579-a4abfadaa25b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528566 Feb 15 04:24:04.714043 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 286/598] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:24:04 2022] POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:05.016326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:05.016955 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:05.022949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:05.023400 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:05.024180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:05.024711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:05.201383 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:05.209080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:05.211359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:05.214547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ce54b9c3-1602-4440-bed4-e1e7e8d092e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.200202 Feb 15 04:24:05.225054 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 313/599] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:05 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:05.712214 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:05.713566 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:05.721527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:05.721973 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:05.722766 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:05.723463 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:05.902122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:05.912317 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-747918cc-5e6f-430b-9640-c3feec6e5792 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.204475 Feb 15 04:24:05.913387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 287/600] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:05 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:06.250784 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:06.251616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:06.258781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:06.259315 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:06.260199 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:06.260689 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:06.473226 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:06.486293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:06.488815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:06.490429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1e2e6e13-6b3e-4148-9d28-e2a343a80689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.259795 Feb 15 04:24:06.491042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 314/601] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:06 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:06.938617 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:06.940677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:06.959971 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:06.960928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:06.962431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:06.963513 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:07.237734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:07.251952 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0b4c3370-96d2-4b6c-a89c-4f9f06b54951 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.322753 Feb 15 04:24:07.253376 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 288/602] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:06 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:07.520775 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:07.521847 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:07.531716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:07.532487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:07.533676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:07.534212 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:07.729995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:07.740869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:07.742339 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:07.743542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-05eb938b-6b08-4c4f-a1f1-21a9a376125c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.226830 Feb 15 04:24:07.744116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 315/603] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:07 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:08.270756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:08.271346 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:08.278168 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:08.278652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:08.279524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:08.279996 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:08.434842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:08.443283 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-570e8552-2d7f-4579-89ec-6e0120874385 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.176716 Feb 15 04:24:08.443860 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 289/604] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:08 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:08.763290 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:08.764067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:08.770575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:08.771418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:08.772592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:08.773406 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:08.898337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-fd7e9fa2-3078-4ee4-ab34-0f7f2b4216d1 req-fa470da2-c5f6-4a47-9a49-0ce6133c3703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "name": "network-vif-plugged", "status": "completed", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:08.901644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:24:08.901644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:24:08.916449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-fd7e9fa2-3078-4ee4-ab34-0f7f2b4216d1 req-fa470da2-c5f6-4a47-9a49-0ce6133c3703 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:08.917267 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-fd7e9fa2-3078-4ee4-ab34-0f7f2b4216d1 req-fa470da2-c5f6-4a47-9a49-0ce6133c3703 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:08.940146 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-fd7e9fa2-3078-4ee4-ab34-0f7f2b4216d1 req-fa470da2-c5f6-4a47-9a49-0ce6133c3703 service nova] Creating event network-vif-plugged:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:24:08.948391 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-fd7e9fa2-3078-4ee4-ab34-0f7f2b4216d1 req-fa470da2-c5f6-4a47-9a49-0ce6133c3703 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057904 Feb 15 04:24:08.949556 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 290/605] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:08.967511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:08.979150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:08.981674 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:08.983061 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-431b6799-3cb9-4635-972e-27bd3da19f2c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.224091 Feb 15 04:24:08.983769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 316/606] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:08 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:09.478131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:09.478872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:09.486392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:09.486915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:09.487773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:09.488246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:09.659031 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:09.667603 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fb97507e-35f3-4cbd-8c4f-a47a2e312b4b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.193948 Feb 15 04:24:09.668757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 291/607] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:09 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:10.003192 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:10.003784 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:10.011345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:10.012496 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:10.013511 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:10.014130 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:10.191980 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:10.201183 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:10.202733 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:10.203927 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bb64ef8b-6c67-4701-909c-16a38ff9309d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.204968 Feb 15 04:24:10.204493 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 317/608] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:09 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:10.694606 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:10.695270 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:10.703397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:10.703850 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:10.704667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:10.705155 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:10.874363 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:10.885178 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-937dc161-79cd-4e55-b0bd-c09d7f5f334a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.194077 Feb 15 04:24:10.886231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 292/609] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:10 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:11.232867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:11.233483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:11.240061 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:11.240519 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:11.241343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:11.241782 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:11.391544 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:11.400305 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:11.401849 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:11.403041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1e7729a0-d38d-4a63-9ae9-a1022f1f66fe tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.173946 Feb 15 04:24:11.403616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 318/610] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:11 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:11.909105 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:11.909666 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:11.916168 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:11.916627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:11.917437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:11.918356 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:12.076413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:12.084306 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d4768e5a-7ab0-4f9c-b8a3-96c61eaac626 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.178972 Feb 15 04:24:12.084878 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 293/611] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:11 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:12.421404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:12.421970 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:12.428101 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:12.428546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:12.429360 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:12.429793 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:12.575859 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:12.584228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:12.585751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:12.586886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-61b61c50-e6aa-4509-9a29-769960666b1e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.169893 Feb 15 04:24:12.587459 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 319/612] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:12 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:13.102455 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:13.103099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:13.110495 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:13.110939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:13.111724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:13.112157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:13.262289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:13.270787 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6e0ab493-8a44-45db-986e-680ec64ada6a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.171879 Feb 15 04:24:13.271376 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 294/613] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:13 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:13.605381 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:13.605988 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:13.613035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:13.613485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:13.614276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:13.614721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:13.765321 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:13.773610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:13.775099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:13.776251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-78b2bcd2-f844-4c86-a348-82a1ab0da69a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.174580 Feb 15 04:24:13.776813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 320/614] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:13 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:14.288454 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:14.289121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:14.297570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:14.298017 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:14.298802 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:14.299233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:14.454517 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:14.462418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f71babb2-c1f3-4319-a3d5-506a327ee9bf tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.177744 Feb 15 04:24:14.462991 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 295/615] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:14 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:14.795006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:14.795570 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:14.801864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:14.802312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:14.803108 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:14.803532 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:14.937221 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:14.945408 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:14.946951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:14.948088 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-771b5065-23bd-44b1-8a9d-9fc999f47420 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.157138 Feb 15 04:24:14.948636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 321/616] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:14 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:15.480696 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:15.481507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:15.489288 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:15.489978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:15.490983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:15.491685 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:15.636302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:15.646022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c4cf3db6-0c74-47d1-b17d-91e3e9f49c5f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.169693 Feb 15 04:24:15.646673 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 296/617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:15 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:15.966952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:15.967692 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:15.977318 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:15.977763 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:15.978568 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:15.979041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:16.132622 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:16.141041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:16.142539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:16.143698 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c6860b2e-34e4-441d-93ea-c208c9118767 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1744 microversion: 2.20 time: 0.180560 Feb 15 04:24:16.144259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 322/618] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:15 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:16.663418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:16.664048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:16.670876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:16.671334 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:16.672140 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:16.672580 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:16.843657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:16.851605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8ba75eb9-37e8-4721-93fb-bde8869bb46c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.191877 Feb 15 04:24:16.852164 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 297/619] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:16 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:17.165703 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:17.166382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:17.173562 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:17.174814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:17.175823 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:17.176213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:17.334800 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:17.349795 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:17.352779 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:17.355441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9fdb4805-dd24-45c1-a643-edccc21b195f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.197097 Feb 15 04:24:17.371610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 323/620] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:17 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:17.880056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:17.880698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:17.916106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:17.917264 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:17.924680 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:17.925559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:18.193817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:18.203595 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-24e185e0-b2b7-420b-b468-05b471e61134 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.335605 Feb 15 04:24:18.204523 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 298/621] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:17 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:18.385741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:18.388058 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:18.400067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:18.401377 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:18.403297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:18.405697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:18.707765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:18.726297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:18.730652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:18.733980 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8893a643-e3b6-447d-bca2-bb68ca938d95 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.358948 Feb 15 04:24:18.735719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 324/622] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:18 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:18.965246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:18.967076 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:18.979938 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:18.980928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:18.985256 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:18.987116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:19.224452 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:19.225568 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:19.246859 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:19.248169 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:19.249237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:19.250529 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:19.287841 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:19.297646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a4d4b225-5334-40b2-bbf9-533c83866397 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1593 microversion: 2.1 time: 0.341075 Feb 15 04:24:19.298757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 299/623] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:18 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1593 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:19.489871 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:19.508660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-61685f8a-c91b-41f1-85a3-f498c94cc71b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.290442 Feb 15 04:24:19.511952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 325/624] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:19 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:19.764699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:19.766470 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:19.784309 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:19.786068 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:19.787657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:19.788319 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:20.384547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:20.403261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:20.409716 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:20.411213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f50cc715-b761-432c-ae03-aa312a5d85a0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.655402 Feb 15 04:24:20.411854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 300/625] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:19 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:20.527138 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:20.527759 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:20.543933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:20.547205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:20.548228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:20.548672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:20.894527 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:20.904883 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-faa44fff-a692-4282-ac0e-aaecefe7bb22 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.380966 Feb 15 04:24:20.915171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 326/626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:20 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:21.436466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:21.438647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:21.454383 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:21.455118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:21.456838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:21.457485 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:21.926850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:21.929279 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:21.966652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:21.971211 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:21.975412 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:21.979530 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:22.112935 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:22.133176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:22.152646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:22.156566 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bac5b5f3-93a3-4d8f-86d4-a4d0a8db5894 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.722443 Feb 15 04:24:22.157889 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 301/627] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:21 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:22.300372 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:22.308595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-38b1a453-76f2-4b54-91f6-12d921818da9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1723 microversion: 2.1 time: 0.389776 Feb 15 04:24:22.311742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 327/628] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:21 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:23.188211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:23.191450 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:23.217610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:23.222352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:23.229091 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:23.230758 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:23.331603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:23.332486 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:23.358331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:23.358790 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:23.359623 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:23.360097 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:23.667155 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:23.673723 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:23.680829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:23.682503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:23.683723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b0713d24-6325-4eae-9475-d548e7c09bea tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.509426 Feb 15 04:24:23.695201 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 302/629] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:23 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:23.752253 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-70923daf-5e56-4508-9682-6bd220c772e0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1700 microversion: 2.1 time: 0.418836 Feb 15 04:24:23.789561 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 328/630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:23 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1700 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:23.793337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-466817d2-787a-4c68-ab26-825d0c3a6028 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:23.800879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-466817d2-787a-4c68-ab26-825d0c3a6028 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:23.804669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-466817d2-787a-4c68-ab26-825d0c3a6028 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:23.933028 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-466817d2-787a-4c68-ab26-825d0c3a6028 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Going to try to start instance {{(pid=116304) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 15 04:24:24.011588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-f5d48b6f-6feb-4ee0-8a9e-548fec939231 req-1f33a89c-1ea3-4b0d-a0cd-97f2d1ad282c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:24.021655 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:24:24.021655 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:24:24.044587 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-466817d2-787a-4c68-ab26-825d0c3a6028 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action" status: 202 len: 0 microversion: 2.1 time: 0.254608 Feb 15 04:24:24.045217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 303/631] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:24:23 2022] POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:24:24.061872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:24.062651 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:24.075718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:24.076253 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:24.077152 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:24.077601 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:24.083048 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-f5d48b6f-6feb-4ee0-8a9e-548fec939231 req-1f33a89c-1ea3-4b0d-a0cd-97f2d1ad282c service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:24.083832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-f5d48b6f-6feb-4ee0-8a9e-548fec939231 req-1f33a89c-1ea3-4b0d-a0cd-97f2d1ad282c service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:24.118472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-f5d48b6f-6feb-4ee0-8a9e-548fec939231 req-1f33a89c-1ea3-4b0d-a0cd-97f2d1ad282c service nova] Creating event network-changed:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:24:24.133156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-f5d48b6f-6feb-4ee0-8a9e-548fec939231 req-1f33a89c-1ea3-4b0d-a0cd-97f2d1ad282c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138560 Feb 15 04:24:24.135320 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 329/632] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:24.706499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:24.707263 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:24.727769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:24.734718 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:24.736120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:24.739351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:25.064540 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:25.073594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:25.078807 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:25.082560 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7805ce1f-0594-4c59-b88a-034402737a22 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.381181 Feb 15 04:24:25.083831 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 330/633] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:24 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:25.734426 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:25.781290 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-05a800e7-9243-4edb-b81a-ba9fac90ef58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1709 microversion: 2.1 time: 1.730725 Feb 15 04:24:25.801811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 304/634] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:24 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1709 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:26.107617 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:26.111957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:26.138358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:26.143180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:26.145620 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:26.149660 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:26.394726 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-992098777"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:26.395580 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:26.434665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:26.435463 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:26.446915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:26.451434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:26.640873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:26.660932 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:26.663081 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:26.666965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dcf7d3fa-dc63-4a80-a995-cf4a0a83baf6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.567380 Feb 15 04:24:26.668222 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 331/635] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:26 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:26.801204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:26.802682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:26.819942 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:26.824030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:26.825890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:26.829813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:27.162346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:27.188709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-50cbbff8-6699-400d-8d49-7a6cf8119ae3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1709 microversion: 2.1 time: 0.391539 Feb 15 04:24:27.192188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 332/636] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:26 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1709 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:24:27.217122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a74770fd-b876-4399-8d2c-89a9e0c50081", "device": "/dev/sdb"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:27.221920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:27.243652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:27.247544 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:27.249607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:27.250425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:27.379994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.network.security_group_api [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Adding security group 280d7089-d43b-4bbb-bba3-b15d265c64ac to port 40ec21d0-c71c-4bbb-ae5d-68d36612fd1a Feb 15 04:24:28.270227 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7c257b71-83f7-4615-add7-31ce95e7c916 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "POST /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.073151 Feb 15 04:24:28.271563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 333/637] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:24:27 2022] POST /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f/os-volume_attachments => generated 194 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:28.327507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:28.331994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:28.357892 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:28.359255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:28.362841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:28.368278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:28.704562 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d3bea98a-70c6-497a-b06e-79af874a7a44 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/action" status: 202 len: 0 microversion: 2.1 time: 2.315198 Feb 15 04:24:28.707932 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 305/638] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:24:26 2022] POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/action => generated 0 bytes in 2321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:24:28.744475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:28.745429 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:28.783550 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:28.784841 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:28.787168 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:28.788735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:29.042114 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:29.060515 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:29.062853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:29.066462 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f0ffc42a-0d8a-4ae3-a358-d6073db371fa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.792757 Feb 15 04:24:29.073923 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 334/639] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:28 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:29.080857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:29.089523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:29.112332 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:29.113315 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:29.118369 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:29.119275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:29.246109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:29.260775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-64efa5b6-fe92-49cc-8395-3f557f3429d9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1713 microversion: 2.1 time: 0.549487 Feb 15 04:24:29.262163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 306/640] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:28 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1713 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:29.269520 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-9db6ae07-47b3-47ba-9743-5f00ddacb467 req-dc6b45f9-0f97-4c73-81f2-fc3bc8eb858f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:29.271557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:24:29.271557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:24:29.281907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9db6ae07-47b3-47ba-9743-5f00ddacb467 req-dc6b45f9-0f97-4c73-81f2-fc3bc8eb858f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:29.282693 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9db6ae07-47b3-47ba-9743-5f00ddacb467 req-dc6b45f9-0f97-4c73-81f2-fc3bc8eb858f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:29.312677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-9db6ae07-47b3-47ba-9743-5f00ddacb467 req-dc6b45f9-0f97-4c73-81f2-fc3bc8eb858f service nova] Creating event network-changed:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:24:29.325958 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-9db6ae07-47b3-47ba-9743-5f00ddacb467 req-dc6b45f9-0f97-4c73-81f2-fc3bc8eb858f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061166 Feb 15 04:24:29.336490 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 307/641] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:29.453364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:29.470532 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-390ab1c2-b39d-43d1-80d8-2bd6387f0c54 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1757 microversion: 2.1 time: 0.394118 Feb 15 04:24:29.471632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 335/642] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:24:29 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1757 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:24:30.123834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:30.125671 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:30.158677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:30.159865 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:30.160936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:30.166442 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:30.561960 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:30.573364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:30.575441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:30.576280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3140f963-6685-4cfe-aa67-027e7d5bef51 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.474472 Feb 15 04:24:30.576860 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 308/643] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:30 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:31.602459 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:31.603260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:31.613666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:31.614743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:31.615847 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:31.616491 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:31.899233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:31.916713 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:31.920805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:31.922762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e5626377-6d9e-40e6-88f0-f95ba365bc3f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.324708 Feb 15 04:24:31.923503 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 336/644] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:31 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:32.951285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:32.952458 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:32.977145 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:32.977873 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:32.978943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:32.979391 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:33.327340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:33.346737 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:33.351124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:33.356448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4208a020-96e2-489c-8df0-ff2fdc3d7a77 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.411556 Feb 15 04:24:33.357578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 309/645] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:32 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:34.379768 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:34.380989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:34.392625 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:34.393462 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:34.394873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:34.395767 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:34.645760 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:34.670975 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:34.675231 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:34.677267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3ac43f5e-ca78-4537-ae50-c43ea4f19277 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1739 microversion: 2.20 time: 0.304013 Feb 15 04:24:34.678302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 337/646] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:34 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:35.710796 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:35.712109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:35.722914 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:35.723660 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:35.724647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:35.725306 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:36.101909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:36.119949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:36.122026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:36.123633 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d2ea933d-1c91-4fff-9a0a-6ce0ef149f30 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1721 microversion: 2.20 time: 0.420203 Feb 15 04:24:36.124675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 310/647] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:35 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:37.148964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:37.150182 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:37.161609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:37.163128 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:37.165734 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:37.166986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:37.368473 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:37.380022 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:37.381944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:37.383616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fed750a6-ea5b-4e56-a8de-c235e5ba696c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1721 microversion: 2.20 time: 0.242380 Feb 15 04:24:37.384397 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 338/648] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:37 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:38.408293 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:38.409443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:38.417128 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:38.417598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:38.419941 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:38.420503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:38.873079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:38.884083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:38.888548 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:38.890172 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cc477aad-2d78-469c-9df7-94a0006e7539 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1721 microversion: 2.20 time: 0.489544 Feb 15 04:24:38.890985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 311/649] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:38 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1721 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:39.459175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-22870ec5-01b9-45be-a29f-d8b98d76af15 req-3a6de4fb-f5cc-4dc8-ab65-6b6a17cd8571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "name": "network-vif-unplugged", "status": "completed", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:39.463572 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:24:39.463572 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:24:39.481051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-22870ec5-01b9-45be-a29f-d8b98d76af15 req-3a6de4fb-f5cc-4dc8-ab65-6b6a17cd8571 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:39.482761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-22870ec5-01b9-45be-a29f-d8b98d76af15 req-3a6de4fb-f5cc-4dc8-ab65-6b6a17cd8571 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:39.508582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-22870ec5-01b9-45be-a29f-d8b98d76af15 req-3a6de4fb-f5cc-4dc8-ab65-6b6a17cd8571 service nova] Creating event network-vif-unplugged:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:24:39.521175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-22870ec5-01b9-45be-a29f-d8b98d76af15 req-3a6de4fb-f5cc-4dc8-ab65-6b6a17cd8571 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077295 Feb 15 04:24:39.522531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 339/650] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:24:39.910345 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:39.911688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:39.919682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:39.921403 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:39.922259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:39.922788 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:40.095806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:40.116713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:40.118299 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:40.120143 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7dc8af15-cba7-4742-9823-e141c3bef24e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1721 microversion: 2.20 time: 0.213629 Feb 15 04:24:40.120704 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 312/651] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:39 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:41.139528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:41.140285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:41.147857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:41.148708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:41.150092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:41.150533 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:41.582464 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:41.592146 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:41.593860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:41.595081 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fea880d3-aa06-4af4-8926-3d0eb244feba tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1721 microversion: 2.20 time: 0.459728 Feb 15 04:24:41.595659 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 340/652] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:41 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:42.615849 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:42.617130 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:42.625095 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:42.625814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:42.626803 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:42.627238 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:42.842886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:42.850798 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:42.852754 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:42.854309 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-299b1775-8ae8-421a-9b9a-66167a5116b1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1664 microversion: 2.20 time: 0.242137 Feb 15 04:24:42.855152 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 313/653] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:42 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:42.874321 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45f533aa-6103-4e15-b469-c74c7d0b8fae"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:42.875449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:42.884462 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:42.884835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:42.885790 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:42.886233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:43.189127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-93b35242-91fd-4214-af9b-3276752479c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319133 Feb 15 04:24:43.189751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 341/654] 10.222.0.45 () {62 vars in 1363 bytes} [Tue Feb 15 04:24:42 2022] POST /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 04:24:43.316019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:24:43.316591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:43.322644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:43.323219 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:43.323872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:43.324874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:43.546517 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-566b9b63-01a5-41bf-9a05-782ec9c9adfa tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/action" status: 202 len: 0 microversion: 2.20 time: 0.234108 Feb 15 04:24:43.547612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 314/655] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Feb 15 04:24:43 2022] POST /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:24:43.561177 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:43.562415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:43.575330 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:43.576285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:43.578054 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:43.579023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:43.811047 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:43.826171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:43.828071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:43.829886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-30775c58-55a9-4403-8814-c770b823f1b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1750 microversion: 2.20 time: 0.276482 Feb 15 04:24:43.831304 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 342/656] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:43 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1750 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:44.854127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:44.854731 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:44.867247 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:44.868005 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:44.869979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:44.870683 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:45.038261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:45.049991 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:45.052138 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:45.053581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3d147b1e-3b43-490d-8f06-1b893f27cec6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1750 microversion: 2.20 time: 0.202874 Feb 15 04:24:45.054179 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 315/657] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:44 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:46.072670 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:46.073399 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:46.081203 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:46.081658 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:46.082593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:46.083014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:46.239223 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:46.248750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:46.250439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:46.251610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7c1ff611-c64a-4d0a-8f77-3ef8b325280a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1750 microversion: 2.20 time: 0.182627 Feb 15 04:24:46.252172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 343/658] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:46 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:47.273427 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:47.274027 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:47.280869 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:47.281345 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:47.282131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:47.282568 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:47.421393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:47.429664 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:47.431153 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:47.432311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e58b33a9-d566-45fd-9af2-5af674342f31 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1752 microversion: 2.20 time: 0.163935 Feb 15 04:24:47.432875 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 316/659] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:47 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:24:48.451166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:48.451859 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:48.458250 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:48.458697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:48.459525 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:48.459958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:48.603452 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:48.612586 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:48.614182 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:48.615352 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e501c2af-43ab-4a11-9a2c-0cdb4272233f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1752 microversion: 2.20 time: 0.168350 Feb 15 04:24:48.615925 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 344/660] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:48 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:49.634075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:49.634642 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:49.641305 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:49.641750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:49.642534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:49.642969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:49.779827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:49.788259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:49.789779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:49.790937 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3a1101ff-2d5e-451f-972b-2e72a7d6874a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1752 microversion: 2.20 time: 0.160808 Feb 15 04:24:49.791504 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 317/661] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:49 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:50.809974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:50.811328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:50.817962 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:50.818408 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:50.819193 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:50.819621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:51.013302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:51.022300 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:51.023779 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:51.025037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6edd4859-58d1-41f5-8291-a050f517f54d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1752 microversion: 2.20 time: 0.219252 Feb 15 04:24:51.025617 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 345/662] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:50 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:52.048939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:52.049468 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:52.055668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:52.056115 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:52.056923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:52.057361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:52.210424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:52.219681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:52.221203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:52.222364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bfb368fa-eb79-4cae-ab87-9021742a5e87 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1752 microversion: 2.20 time: 0.178623 Feb 15 04:24:52.222918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 318/663] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:52 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:53.239410 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:53.240018 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:53.246771 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:53.247220 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:53.248014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:53.249045 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:53.385451 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:53.394116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:53.395612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:53.396748 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d366144a-10a6-44b0-8827-980db1eaf8ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1752 microversion: 2.20 time: 0.161086 Feb 15 04:24:53.397336 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 346/664] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:53 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:54.414947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:54.415742 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:54.422873 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:54.423314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:54.424093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:54.424515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:54.569751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:54.578551 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:54.580053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:54.581298 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a039f101-5a3f-47ce-8e81-e0ca387f394a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.170184 Feb 15 04:24:54.581863 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 319/665] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:54 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:55.599364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:55.599995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:55.606373 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:55.606824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:55.607628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:55.608604 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:55.782756 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:55.792636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:55.794146 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:55.795566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5739171c-cc0c-4865-a136-7f87b5af1843 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.199888 Feb 15 04:24:55.796258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 347/666] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:55 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:57.010129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:57.010744 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:57.016980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:57.017432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:57.018234 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:57.018672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:57.169151 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:57.178382 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:57.179919 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:57.181180 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3f70a17e-3cff-4ddf-bc1c-ceb94745a8f4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.370184 Feb 15 04:24:57.181735 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 320/667] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:56 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:57.986111 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:57.987561 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:58.007952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:58.008662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:58.009683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:58.018055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:58.117605 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lazy-loading 'services' on Instance uuid cf316805-ef34-4e31-9a87-59a0b8c0e09f {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:24:58.200570 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:58.201324 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:58.210826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:58.211895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:58.213341 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:58.214300 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:58.235025 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0cbe5783-daa7-40c6-85f7-0df65000dbf2 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f/os-volume_attachments/a74770fd-b876-4399-8d2c-89a9e0c50081" status: 202 len: 0 microversion: 2.1 time: 0.252468 Feb 15 04:24:58.235795 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 348/668] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:24:57 2022] DELETE /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f/os-volume_attachments/a74770fd-b876-4399-8d2c-89a9e0c50081 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 04:24:58.473432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:58.482420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:58.486477 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:58.487702 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4c8e886e-f7a6-4b44-80a6-e2702f3da8f0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.291526 Feb 15 04:24:58.488460 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 321/669] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:58 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:24:59.512978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:24:59.515822 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:24:59.526952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:59.527757 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:59.529567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:24:59.530395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:24:59.849480 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:59.860334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:59.862845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:24:59.864276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7103b476-37a5-4e83-bd38-276fcbbe3531 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.361281 Feb 15 04:24:59.865607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 349/670] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:24:59 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:00.885753 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:00.886394 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:00.902020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:00.902472 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:00.903262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:00.903698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:01.091482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:01.100518 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:01.102023 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:01.103171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3e3f7e9d-31b7-4ffc-9ac6-5b73c17ad7ec tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.223241 Feb 15 04:25:01.103713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 322/671] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:00 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:02.123010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:02.123656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:02.134148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:02.134898 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:02.136450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:02.137336 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:02.495265 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:02.511180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:02.513764 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:02.515670 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4105aac5-ae8e-4b9f-bbbf-14f75ec3b5b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.396632 Feb 15 04:25:02.516490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 350/672] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:02 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:03.535277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:03.535942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:03.542408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:03.542901 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:03.543723 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:03.544184 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:03.711759 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:03.738645 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:03.742126 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:03.744739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ca6705ee-a49c-40e7-95f5-210ba8697ac8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.213026 Feb 15 04:25:03.746133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 323/673] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:03 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:04.767131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:04.768174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:04.775720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:04.776278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:04.777216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:04.777727 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:04.961475 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:04.971376 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:04.972850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:04.974034 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4787e5b3-d211-443f-83f0-9989940347ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.213278 Feb 15 04:25:04.974581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 351/674] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:04 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:06.001184 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:06.002323 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:06.020885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:06.022582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:06.025196 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:06.026044 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:06.271910 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:06.281387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:06.283004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:06.284183 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0b568214-aa54-4b1b-b12b-279dab8c67a3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.292937 Feb 15 04:25:06.284752 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 324/675] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:05 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:07.307037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:07.307685 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:07.316025 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:07.316467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:07.317308 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:07.317743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:07.732115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:07.741535 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:07.743023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:07.744443 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3650dda4-6377-46f1-87e1-c7bfa74d6664 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.441126 Feb 15 04:25:07.745023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 352/676] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:07 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:08.764970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:08.765948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:08.776502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:08.777061 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:08.778265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:08.778964 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:08.964684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:08.977980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:08.979502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:08.980666 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f4f6ac76-a7f5-4132-8560-12df23662d2d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.221333 Feb 15 04:25:08.981277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 325/677] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:08 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:10.001730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:10.002362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:10.009417 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:10.009873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:10.010695 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:10.011128 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:10.169796 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:10.179011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:10.180601 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:10.181730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-45fd7e42-183a-486b-9de2-0d2174ca5a34 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.184119 Feb 15 04:25:10.182295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 353/678] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:09 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:11.201230 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:11.202150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:11.208308 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:11.208762 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:11.209578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:11.210025 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:11.354254 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:11.367788 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:11.370396 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:11.372171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fe35f41b-702d-458d-bed7-65f4ec748dae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.174849 Feb 15 04:25:11.373017 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 326/679] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:11 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:12.391015 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:12.391631 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:12.397964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:12.398408 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:12.399320 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:12.399613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:12.536989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:12.546382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:12.548017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:12.549203 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-577b00a9-8975-44ec-a2b2-a45cfdefbacd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.162163 Feb 15 04:25:12.549755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 354/680] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:12 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:13.306487 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:13.307010 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:13.313245 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:13.313689 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:13.314495 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:13.314925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:13.339249 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:25:13.414489 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6c27173f-542d-4fc7-89de-57ef94477b58 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 204 len: 0 microversion: 2.1 time: 0.111333 Feb 15 04:25:13.415103 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 327/681] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:25:13 2022] DELETE /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:25:13.423517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:13.424134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:13.430356 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:13.430805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:13.431582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:13.432018 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:13.569916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:13.571248 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:13.572409 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:13.582161 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:13.582731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-19217c04-69c7-44cd-9056-8319c17bfcae tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1513 microversion: 2.1 time: 0.162782 Feb 15 04:25:13.582879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:13.583697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 355/682] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:13 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:13.584255 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:13.585177 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:13.731419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:13.740628 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:13.742152 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:13.743568 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d1a4dc8a-5bd0-4bd0-bfa1-e324611e418a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.178688 Feb 15 04:25:13.744131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 328/683] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:13 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:14.607368 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:14.608547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:14.614912 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:14.615367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:14.616152 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:14.616590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:14.753109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:14.760528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-52794ab5-07cd-449d-ab13-7fe0e8eefa37 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1513 microversion: 2.1 time: 0.156871 Feb 15 04:25:14.761122 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 356/684] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:14 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:14.762320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:14.762938 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:14.770524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:14.770980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:14.771778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:14.772269 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:14.905272 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:14.913409 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:14.914903 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:14.916085 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-37b8d4f9-a983-427d-a5ee-5a3f31415ff2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.157589 Feb 15 04:25:14.916707 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 329/685] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:14 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:15.777819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:15.778578 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:15.786028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:15.786482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:15.787485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:15.787925 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:15.934541 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:15.935793 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:15.945976 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:15.946420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:15.947667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:15.948420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:15.953910 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:15.961257 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0f8bc7ea-ad7a-4e02-9942-a15b5eb9227c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 200 len: 1513 microversion: 2.1 time: 0.187322 Feb 15 04:25:15.961835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 357/686] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:15 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:16.196029 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:16.206014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:16.207685 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:16.209014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6020576d-387c-4fb3-9008-abe76c21b997 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.278167 Feb 15 04:25:16.210062 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 330/687] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:15 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:16.380922 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-af9f90d1-5fe6-4ab4-b445-c8c39b7df56f req-78092724-27bf-4b97-9442-9bf5535acc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf316805-ef34-4e31-9a87-59a0b8c0e09f", "name": "network-vif-deleted", "tag": "21effa65-6f1f-4199-a6a4-698a3f85a8cf"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:25:16.382498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:25:16.382498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:25:16.389912 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-af9f90d1-5fe6-4ab4-b445-c8c39b7df56f req-78092724-27bf-4b97-9442-9bf5535acc22 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:16.390589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-af9f90d1-5fe6-4ab4-b445-c8c39b7df56f req-78092724-27bf-4b97-9442-9bf5535acc22 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:16.401959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-af9f90d1-5fe6-4ab4-b445-c8c39b7df56f req-78092724-27bf-4b97-9442-9bf5535acc22 service nova] Creating event network-vif-deleted:21effa65-6f1f-4199-a6a4-698a3f85a8cf for instance cf316805-ef34-4e31-9a87-59a0b8c0e09f on hv-cinder-81610 Feb 15 04:25:16.407960 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-af9f90d1-5fe6-4ab4-b445-c8c39b7df56f req-78092724-27bf-4b97-9442-9bf5535acc22 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255502 Feb 15 04:25:16.408570 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 358/688] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:25:16.978178 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:16.978829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: cf316805-ef34-4e31-9a87-59a0b8c0e09f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:16.986142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:16.986484 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:16.987677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:16.988221 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:17.004791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] HTTP exception thrown: Instance cf316805-ef34-4e31-9a87-59a0b8c0e09f could not be found. Feb 15 04:25:17.005427 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Returning 404 to user: Instance cf316805-ef34-4e31-9a87-59a0b8c0e09f could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:25:17.010838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-88b45ede-ac64-4d53-b768-f3cffae1dd09 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f" status: 404 len: 111 microversion: 2.1 time: 0.034218 Feb 15 04:25:17.013101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 331/689] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:16 2022] GET /compute/v2.1/servers/cf316805-ef34-4e31-9a87-59a0b8c0e09f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:25:17.229277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:17.229875 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:17.238711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:17.239163 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:17.239953 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:17.240415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:17.380388 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:17.388878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:17.390988 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:17.392149 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-216bab2f-8e1d-417c-a620-631c2894eaa2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.167596 Feb 15 04:25:17.392703 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 359/690] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:17 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:18.410729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:18.411370 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:18.417845 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:18.418296 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:18.419085 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:18.419521 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:18.563467 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:18.571931 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:18.573531 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:18.574702 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-97682cb2-a570-42d9-b9d6-5c5d09f589db tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.167777 Feb 15 04:25:18.575255 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 332/691] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:18 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:19.593479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:19.594077 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:19.601047 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:19.601495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:19.602281 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:19.602710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:19.751849 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:19.761305 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:19.762770 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:19.763933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a645baf7-f467-41c5-80f9-cd9aed84c0af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.174927 Feb 15 04:25:19.764995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 360/692] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:19 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:20.782884 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:20.783479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:20.790479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:20.790893 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:20.791951 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:20.792424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:20.940511 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:20.949216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:20.950717 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:20.951869 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c7509c5e-7cff-4aa1-8228-8cb62b233d88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.172761 Feb 15 04:25:20.952424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 333/693] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:20 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:21.970912 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:21.971514 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:21.978272 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:21.978642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:21.979442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:21.979882 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:22.121604 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:22.132363 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:22.133995 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:22.135166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-19be85bb-1cb5-41b2-9826-f0735f9511fd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.168567 Feb 15 04:25:22.135728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 361/694] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:21 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:23.154860 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:23.155462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:23.162668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:23.163120 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:23.163907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:23.164346 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:23.306891 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:23.315466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:23.317005 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:23.318183 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d1f23e32-571c-4d67-ac3e-571c7034068c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.167024 Feb 15 04:25:23.318745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 334/695] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:23 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:24.337427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:24.338194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:24.345703 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:24.346384 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:24.347383 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:24.347929 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:24.493735 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:24.503495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:24.505034 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:24.506284 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-05c2d25e-af7a-435d-bb97-e476f3b95575 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.173022 Feb 15 04:25:24.506785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 362/696] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:24 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:25.525496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:25.526086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:25.533158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:25.533607 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:25.534390 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:25.534823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:25.680503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:25.689680 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:25.691182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:25.692343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-577176ca-3710-4344-a927-bbb608a77f24 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.170585 Feb 15 04:25:25.692912 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 335/697] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:25 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:26.710205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:26.710814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:26.717356 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:26.717817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:26.719118 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:26.719702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:26.859045 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:26.868864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:26.870528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:26.871749 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-cb4465ea-b831-4ea8-a944-8c8a0f03f0ef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.165340 Feb 15 04:25:26.872313 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 363/698] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:26 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:27.890532 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:27.891193 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:27.897488 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:27.897939 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:27.898713 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:27.899142 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:28.038725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:28.046936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:28.049235 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:28.050378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c60ac033-5cdc-4c4b-a442-bba553c80cfc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.163625 Feb 15 04:25:28.050932 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 336/699] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:27 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:29.068070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:29.068674 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:29.075767 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:29.076217 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:29.077030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:29.077463 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:29.124099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1756057981", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "networks": [{"uuid": "1623b098-48ca-48ad-88dc-118d6853c0b8"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:25:29.178930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] validate_networks() for [('1623b098-48ca-48ad-88dc-118d6853c0b8', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:25:29.231204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:29.239593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:29.241117 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:29.242293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2b04c958-9e3d-46e4-87c5-cfdfb830ff83 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.177889 Feb 15 04:25:29.243101 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 364/700] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:29 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:29.514369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:25:29.514789 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:25:29.515258 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:25:29.515661 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:25:29.516069 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:25:29.525326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:29.525767 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:29.526584 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:29.527019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:29.544329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Getting quotas for project 1ba3b5e2169b40148cfb3daa6fb61162. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:25:29.549392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Getting quotas for user 956bd79de25a40aca93e520cfaa296bd and project 1ba3b5e2169b40148cfb3daa6fb61162. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:25:29.560476 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:25:29.562887 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:25:29.616918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6f6b5e16-c8e3-4164-b0de-3f34ef0b4f3f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496924 Feb 15 04:25:29.618007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 337/701] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 04:25:29.627857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-eeb3b8fc-dc89-40a4-a95b-07264eb6f034 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:29.628465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-eeb3b8fc-dc89-40a4-a95b-07264eb6f034 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:29.682417 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-eeb3b8fc-dc89-40a4-a95b-07264eb6f034 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:29.689251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-eeb3b8fc-dc89-40a4-a95b-07264eb6f034 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1219 microversion: 2.1 time: 0.065056 Feb 15 04:25:29.690025 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 365/702] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:29 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:29.925299 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-14865b20-95d3-43fc-a590-8bae50ec7bf3 req-bdb308e3-3220-40c6-b19f-a9930843361c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "name": "network-vif-plugged", "status": "completed", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:25:29.929800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:25:29.929800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:25:29.938025 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-14865b20-95d3-43fc-a590-8bae50ec7bf3 req-bdb308e3-3220-40c6-b19f-a9930843361c service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:29.938677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-14865b20-95d3-43fc-a590-8bae50ec7bf3 req-bdb308e3-3220-40c6-b19f-a9930843361c service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:29.949213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-14865b20-95d3-43fc-a590-8bae50ec7bf3 req-bdb308e3-3220-40c6-b19f-a9930843361c service nova] Creating event network-vif-plugged:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:25:29.955022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-14865b20-95d3-43fc-a590-8bae50ec7bf3 req-bdb308e3-3220-40c6-b19f-a9930843361c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113790 Feb 15 04:25:29.955811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 338/703] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:25:30.261654 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:30.262258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:30.269398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:30.269846 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:30.270643 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:30.271085 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:30.421324 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:30.430382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:30.431940 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:30.433156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-586f209f-21aa-495d-8df6-26743449a014 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.175215 Feb 15 04:25:30.434013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 366/704] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:30 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:30.707640 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:30.708446 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:30.715109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:30.715565 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:30.716358 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:30.717010 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:30.786405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:30.794784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-44279164-34b0-4e98-bdf2-91eeac9072d4 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1277 microversion: 2.1 time: 0.092435 Feb 15 04:25:30.795548 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 339/705] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:30 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:31.451857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:31.452593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:31.460666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:31.461432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:31.462369 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:31.462906 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:31.621554 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:31.629914 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:31.631412 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:31.632585 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d1934367-c7b4-4e46-ab80-dc7b6024c471 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.184710 Feb 15 04:25:31.633171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 367/706] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:31 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:31.811275 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:31.811907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:31.818975 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:31.819438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:31.820200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:31.820628 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:32.067592 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:32.074812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e246c93a-8b15-4036-a8e9-ef3d4db1da7d tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.267156 Feb 15 04:25:32.075387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 340/707] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:31 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:32.291057 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-a963ef21-0410-4a85-bfc4-30f0768a5782 req-5cbad421-32d3-4ba7-96d1-323d52e92f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf786e8-a4df-438c-bf5a-79f6e0f6cfa7", "tag": "7afafa80-7e31-44e1-9fce-a718fd60cd65"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:25:32.294765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:25:32.294765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:25:32.304131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-a963ef21-0410-4a85-bfc4-30f0768a5782 req-5cbad421-32d3-4ba7-96d1-323d52e92f48 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:32.304587 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-a963ef21-0410-4a85-bfc4-30f0768a5782 req-5cbad421-32d3-4ba7-96d1-323d52e92f48 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:32.318407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-a963ef21-0410-4a85-bfc4-30f0768a5782 req-5cbad421-32d3-4ba7-96d1-323d52e92f48 service nova] Creating event network-changed:7afafa80-7e31-44e1-9fce-a718fd60cd65 for instance abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 on hv-cinder-81610 Feb 15 04:25:32.323935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-a963ef21-0410-4a85-bfc4-30f0768a5782 req-5cbad421-32d3-4ba7-96d1-323d52e92f48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044843 Feb 15 04:25:32.324524 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 368/708] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:25:32.651106 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:32.651741 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:32.659591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:32.659805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:32.660684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:32.661289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:32.900192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:32.910976 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:32.913020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:32.914327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef5c8725-5cff-4350-9eab-bb1d5e42ce94 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1808 microversion: 2.20 time: 0.266986 Feb 15 04:25:32.914894 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 341/709] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:32 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:25:33.091993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:33.092761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:33.100113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:33.100564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:33.101607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:33.102050 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:33.242174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:33.249593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-76fc53bf-b527-471c-9064-5539a451c9fb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.161645 Feb 15 04:25:33.250157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 369/710] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:33 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:33.933432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:33.934019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:33.941125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:33.941576 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:33.942360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:33.942784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:34.086019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:34.097818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:34.099295 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:34.100451 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-81510326-337e-4bcd-966e-333310132466 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1795 microversion: 2.20 time: 0.170681 Feb 15 04:25:34.101033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 342/711] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:25:33 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1795 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:25:34.265546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:34.266918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:34.273438 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:34.273890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:34.274715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:34.275152 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:34.434293 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:34.442954 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-71ddfd80-c257-4a41-beed-ccc0924bc08e tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.181057 Feb 15 04:25:34.443528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 370/712] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:34 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:35.462385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:35.463245 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:35.471907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:35.472358 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:35.473181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:35.473620 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:35.619210 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:35.627467 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73ce4cc6-6313-4317-9010-93c89d32a70c tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.170785 Feb 15 04:25:35.628054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 343/713] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:35 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:36.644312 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:36.645013 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:36.651477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:36.651928 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:36.652719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:36.653184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:36.800274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:36.811913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2897d404-ff20-4822-841f-e1999e1bf2bb tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.172065 Feb 15 04:25:36.812514 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 371/714] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:36 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:37.829912 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:37.830636 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:37.837272 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:37.837729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:37.838524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:37.838963 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:37.877268 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-09041305-f4b1-4c84-89ab-3e38b96b6cf2 req-a0082324-8c08-42d1-8148-c45521400a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf786e8-a4df-438c-bf5a-79f6e0f6cfa7", "name": "network-vif-plugged", "status": "completed", "tag": "7afafa80-7e31-44e1-9fce-a718fd60cd65"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:25:37.878792 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:25:37.878792 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:25:37.886439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-09041305-f4b1-4c84-89ab-3e38b96b6cf2 req-a0082324-8c08-42d1-8148-c45521400a02 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:37.886952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-09041305-f4b1-4c84-89ab-3e38b96b6cf2 req-a0082324-8c08-42d1-8148-c45521400a02 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:37.899441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-09041305-f4b1-4c84-89ab-3e38b96b6cf2 req-a0082324-8c08-42d1-8148-c45521400a02 service nova] Creating event network-vif-plugged:7afafa80-7e31-44e1-9fce-a718fd60cd65 for instance abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 on hv-cinder-81610 Feb 15 04:25:37.904436 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-09041305-f4b1-4c84-89ab-3e38b96b6cf2 req-a0082324-8c08-42d1-8148-c45521400a02 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Feb 15 04:25:37.905064 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 372/715] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:25:37.983611 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:37.991601 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-90b3c6e3-acd6-41be-906d-0d02b7650ae8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.166049 Feb 15 04:25:37.992178 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 344/716] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:37 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:39.010667 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:39.011326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:39.018037 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:39.018478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:39.019248 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:39.019673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:39.154322 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:39.162157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-99a415d4-5398-4de5-8e7e-95e75ffe79a8 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1319 microversion: 2.1 time: 0.155954 Feb 15 04:25:39.162709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 373/717] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:39 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:40.178655 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:25:40.179276 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:40.185704 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:40.186190 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:40.186974 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:40.187462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:40.323956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:25:40.331483 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea89d92e-8bd6-45b4-97e0-3d0f57404fc9 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1508 microversion: 2.1 time: 0.156405 Feb 15 04:25:40.332133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 345/718] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:25:40 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:25:40.348662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46905134-41db-4ec8-a241-21b6c51dc93b", "device": "/dev/sdb"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:25:40.349942 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:25:40.356154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:40.356604 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:40.357396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:25:40.357822 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:25:40.599987 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7c819b86-3612-49b8-9bd6-9f8673f4da10 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "POST /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255749 Feb 15 04:25:40.601006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 374/719] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:25:40 2022] POST /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:26:02.943479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:02.944023 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:02.949970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:02.950414 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:02.951181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:02.951608 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:03.031898 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lazy-loading 'services' on Instance uuid abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:26:03.104348 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-03b6bb86-27dd-4078-b21f-a627a9d787a7 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7/os-volume_attachments/46905134-41db-4ec8-a241-21b6c51dc93b" status: 202 len: 0 microversion: 2.1 time: 0.164589 Feb 15 04:26:03.104969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 346/720] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:26:02 2022] DELETE /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7/os-volume_attachments/46905134-41db-4ec8-a241-21b6c51dc93b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:26:04.218191 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:04.220351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:04.227568 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:04.228017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:04.229144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:04.229578 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:04.255387 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:26:04.332053 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4bad5dfd-9949-4568-a32f-41478e3d2caf tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "DELETE /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 204 len: 0 microversion: 2.1 time: 0.117562 Feb 15 04:26:04.336386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 375/721] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:26:04 2022] DELETE /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:26:04.341757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:04.342655 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:04.352052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:04.352698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:04.353928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:04.354865 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:04.490138 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:04.497791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bc1db2d3-41b4-4702-bdfb-f227b2690bee tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1514 microversion: 2.1 time: 0.160033 Feb 15 04:26:04.498361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 347/722] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:04 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:05.516738 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:05.517475 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:05.523871 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:05.524318 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:05.525148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:05.525579 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:05.670264 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:05.678603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f99a1ff0-4999-43f3-8ff4-5bc4f624347f tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1514 microversion: 2.1 time: 0.166181 Feb 15 04:26:05.679172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 376/723] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:05 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:06.695367 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:06.695974 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:06.702300 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:06.702749 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:06.703577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:06.704020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:06.906714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956bd79de25a40aca93e520cfaa296bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba3b5e2169b40148cfb3daa6fb61162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:06.914176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-55a8b360-1c39-4ac2-90e1-2aa6e700deff tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 200 len: 1514 microversion: 2.1 time: 0.222405 Feb 15 04:26:06.914754 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 348/724] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:06 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:07.265867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-91287ef7-c2cd-42ed-a8f1-f53d911f74c8 req-f5dbe4bd-0c56-4bbc-9175-09720d56aeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf786e8-a4df-438c-bf5a-79f6e0f6cfa7", "name": "network-vif-deleted", "tag": "7afafa80-7e31-44e1-9fce-a718fd60cd65"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:26:07.268098 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:26:07.268098 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:26:07.276461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-91287ef7-c2cd-42ed-a8f1-f53d911f74c8 req-f5dbe4bd-0c56-4bbc-9175-09720d56aeaa service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:07.276942 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-91287ef7-c2cd-42ed-a8f1-f53d911f74c8 req-f5dbe4bd-0c56-4bbc-9175-09720d56aeaa service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:07.288442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-91287ef7-c2cd-42ed-a8f1-f53d911f74c8 req-f5dbe4bd-0c56-4bbc-9175-09720d56aeaa service nova] Creating event network-vif-deleted:7afafa80-7e31-44e1-9fce-a718fd60cd65 for instance abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 on hv-cinder-81610 Feb 15 04:26:07.294850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-91287ef7-c2cd-42ed-a8f1-f53d911f74c8 req-f5dbe4bd-0c56-4bbc-9175-09720d56aeaa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032374 Feb 15 04:26:07.295470 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 377/725] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:26:07.930692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:07.931289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] [instance: abf786e8-a4df-438c-bf5a-79f6e0f6cfa7] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:07.938180 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:07.938886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:07.939708 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:07.940145 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:07.954665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] HTTP exception thrown: Instance abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 could not be found. Feb 15 04:26:07.955256 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] Returning 404 to user: Instance abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:26:07.956079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ed9ac290-05fb-44b4-b1cb-467043c9c206 tempest-VolumesSnapshotTestJSON-504284038 tempest-VolumesSnapshotTestJSON-504284038-project] 10.222.0.45 "GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7" status: 404 len: 111 microversion: 2.1 time: 0.029157 Feb 15 04:26:07.956630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 349/726] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:07 2022] GET /compute/v2.1/servers/abf786e8-a4df-438c-bf5a-79f6e0f6cfa7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:26:14.073290 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:14.074108 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:14.082121 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:14.082731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:14.083652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:14.084142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:14.178748 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lazy-loading 'services' on Instance uuid eda24f72-ec24-4b2a-9eed-23dbe8b9706c {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:26:14.258625 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6be54a7f-2413-4a92-9b44-20a68b97bc10 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-volume_attachments/1bfebf58-7623-4840-828d-881ed2c56550" status: 202 len: 0 microversion: 2.1 time: 0.305449 Feb 15 04:26:14.259209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 378/727] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:26:13 2022] DELETE /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-volume_attachments/1bfebf58-7623-4840-828d-881ed2c56550 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 04:26:15.398994 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-42d8af7f-accd-48d3-986e-6238aefbd2e8 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:26:15.406358 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-42d8af7f-accd-48d3-986e-6238aefbd2e8 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:15.406978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-42d8af7f-accd-48d3-986e-6238aefbd2e8 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:15.435351 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-42d8af7f-accd-48d3-986e-6238aefbd2e8 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Going to try to stop instance {{(pid=116304) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 15 04:26:15.486582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-42d8af7f-accd-48d3-986e-6238aefbd2e8 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action" status: 202 len: 0 microversion: 2.1 time: 0.091242 Feb 15 04:26:15.487200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 350/728] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:26:15 2022] POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:26:15.497991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:15.498835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:15.506474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:15.506930 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:15.507752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:15.508201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:15.658690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:15.666415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2e8f4ade-0b63-470d-8195-e5444cb77a61 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.173732 Feb 15 04:26:15.667063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 379/729] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:15 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:16.686107 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:16.686805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:16.694230 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:16.694672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:16.695461 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:16.695890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:16.855026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:16.863813 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c05445ac-bc42-4ec8-9aaf-0396f28171e3 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.182318 Feb 15 04:26:16.864398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 351/730] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:16 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:17.882064 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:17.882705 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:17.889876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:17.890331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:17.892228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:17.892783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:18.048498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:18.056947 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-35aea515-b64d-47bc-9003-dc02f545da33 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.178814 Feb 15 04:26:18.057539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 380/731] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:17 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:19.074681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:19.075243 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:19.086552 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:19.086997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:19.087791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:19.088225 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:19.248327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:19.256261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9638a961-6df6-4982-826b-c3c95abd0456 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.185446 Feb 15 04:26:19.256869 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 352/732] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:19 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:20.276402 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:20.277072 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:20.285156 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:20.285614 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:20.286467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:20.286933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:20.442893 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:20.450869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-eac32eb2-5034-437d-96fa-65a4d3e040c1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.178628 Feb 15 04:26:20.451534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 381/733] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:20 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:21.469933 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:21.471134 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:21.477630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:21.478139 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:21.478987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:21.479419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:21.672083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:21.680668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5b4070e8-4f05-44df-9533-e49dc94b509d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.215326 Feb 15 04:26:21.681298 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 353/734] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:21 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:22.699253 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:22.700062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:22.706769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:22.707218 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:22.708034 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:22.708472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:22.892115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:26:22.892419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c (ip 10.222.0.45) !!! Feb 15 04:26:22.912375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:22.925810 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-175a345e-8c5e-4530-9457-87e17d8526c0 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.230458 Feb 15 04:26:22.926994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 382/735] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:22 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:26:23.944198 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:23.944800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:23.951610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:23.952057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:23.952866 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:23.953824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:24.148790 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:24.157598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-045d6003-ef9b-45eb-b7fc-efe6764beed4 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.216359 Feb 15 04:26:24.158434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 354/736] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:23 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:25.182517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:25.183151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:25.190697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:25.191189 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:25.192005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:25.192442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:25.378246 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:25.390447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2c081fd9-5e60-41b0-a1e5-74fc616f2996 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.211313 Feb 15 04:26:25.391765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 383/737] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:25 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:26:26.411158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:26.411894 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:26.418908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:26.419359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:26.420160 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:26.420599 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:26.580956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:26.589218 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-245ef0a0-d98d-4079-9f0a-1f1f2a3331a9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.183156 Feb 15 04:26:26.589814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 355/738] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:26 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:27.606972 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:27.607876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:27.615863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:27.616302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:27.617402 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:27.617835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:27.781838 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:27.791958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0cf5527d-7576-4311-bd94-0f2178d91e57 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.188602 Feb 15 04:26:27.792531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 384/739] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:27 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:28.814337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:28.815003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:28.821575 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:28.822024 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:28.822824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:28.823262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:29.010650 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:29.022124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6f8004a6-4af0-4867-85d2-5b22e581ce0f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.212098 Feb 15 04:26:29.023100 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 356/740] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:28 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:30.046367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:30.047289 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:30.056991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:30.058068 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:30.059042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:30.059564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:30.242807 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:30.255938 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-ab993f27-3fd4-4000-b2b6-0098da696755 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1677 microversion: 2.1 time: 0.213695 Feb 15 04:26:30.256915 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 385/741] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:30 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:31.278373 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:31.279020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:31.286830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:31.287332 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:31.288278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:31.288757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:31.504353 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:31.514116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-74acc41d-fbeb-4a27-9532-2f3e8b023793 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1654 microversion: 2.1 time: 0.239685 Feb 15 04:26:31.514890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 357/742] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:31 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1654 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:26:31.535609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3c3e871b-6e54-43f7-9137-9cdae8134a36 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:26:31.543798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3c3e871b-6e54-43f7-9137-9cdae8134a36 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:31.544339 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3c3e871b-6e54-43f7-9137-9cdae8134a36 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:31.576811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3c3e871b-6e54-43f7-9137-9cdae8134a36 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Going to try to start instance {{(pid=116305) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 15 04:26:31.631818 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3c3e871b-6e54-43f7-9137-9cdae8134a36 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action" status: 202 len: 0 microversion: 2.1 time: 0.101548 Feb 15 04:26:31.633345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 386/743] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:26:31 2022] POST /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:26:31.644865 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:31.645749 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:31.654538 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:31.655310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:31.656827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:31.657419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:31.949990 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:31.960393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f0c52e7f-6232-434b-8d46-4e211ee9535f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1663 microversion: 2.1 time: 0.320316 Feb 15 04:26:31.961160 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 358/744] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:31 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1663 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:32.989308 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:32.990550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:33.001707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:33.002395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:33.003793 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:33.004564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:33.199980 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:33.208116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-369ff1cb-10a0-42d6-9c77-17cc399fb701 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1667 microversion: 2.1 time: 0.225451 Feb 15 04:26:33.208757 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 387/745] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:32 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1667 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:38.201508 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:26:38.202131 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:26:38.701080 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:26:38.702127 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:38.708978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:38.709431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:38.710216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:38.710649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:38.791703 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2f268429-38ed-4d63-811a-e7780b328dbf tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/action" status: 202 len: 0 microversion: 2.1 time: 0.094205 Feb 15 04:26:38.792648 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 359/746] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:26:38 2022] POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 04:26:38.803019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:38.803745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:38.811033 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:38.811580 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:38.812575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:38.814067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:39.024682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:39.034127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9cb49759-cd2d-4c5d-a7c7-4d0c5312a666 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1749 microversion: 2.1 time: 0.235707 Feb 15 04:26:39.036937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 388/747] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:38 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1749 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:40.055615 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:40.056210 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:40.063470 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:40.064036 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:40.065254 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:40.065837 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:40.231689 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:40.241846 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ebf26e36-5a2e-46d8-8e76-87603993d4b5 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.190013 Feb 15 04:26:40.242447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 360/748] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:40 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:26:41.260978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:41.261685 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:41.270133 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:41.270628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:41.271517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:41.271982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:41.445454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:41.455828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f6f93502-c590-45a8-b808-275e70f7bc59 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.198790 Feb 15 04:26:41.456528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 389/749] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:41 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:26:42.478114 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:42.479180 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:42.488794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:42.489405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:42.490383 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:42.490884 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:42.655410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:42.664162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-19b3ca41-06b2-479e-9f86-1671802ac07b tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.192866 Feb 15 04:26:42.664752 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 361/750] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:42 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:43.172954 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:26:43.173651 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:26:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:26:43.681730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:43.682495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:43.689713 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:43.690158 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:43.691016 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:43.691457 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:43.874292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:43.883431 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4b138312-3fc3-4068-bb96-d2080b5ddade tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.205343 Feb 15 04:26:43.884030 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 390/751] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:43 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:26:44.902535 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:44.903111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:44.910677 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:44.911118 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:44.911948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:44.912339 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:45.079733 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:45.090934 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3cf75ecf-d4a7-4f32-a593-5bf068d43c69 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.192764 Feb 15 04:26:45.091743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 362/752] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:44 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:46.118334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:46.119177 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:46.126575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:46.127024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:46.127867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:46.128302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:46.296081 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:46.304675 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d1ebeaf7-9c94-4a81-a21c-841dc49dd637 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.192127 Feb 15 04:26:46.305278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 391/753] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:46 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:47.322268 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:47.322890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:47.329982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:47.330435 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:47.331255 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:47.331679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:47.488999 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:47.500184 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-990f9444-bd7e-488c-a73a-1448d8ce01cc tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.178769 Feb 15 04:26:47.500184 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 363/754] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:47 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:48.514783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:48.515948 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:48.522371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:48.527280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:48.527280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:48.527280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:48.671797 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:48.679687 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7bc32ef9-1887-43de-9811-8f6127fcdbc7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.168629 Feb 15 04:26:48.680236 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 392/755] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:48 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:49.697041 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:49.697660 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:49.705756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:49.706192 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:49.706966 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:49.707419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:49.862733 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:49.870841 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ed066e27-172f-4157-b16b-0f01d48048a2 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1754 microversion: 2.1 time: 0.177439 Feb 15 04:26:49.871412 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 364/756] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:49 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:50.887432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:50.888035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:50.895051 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:50.895498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:50.896272 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:50.896706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:51.042482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:51.050628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-31265151-9590-402e-81f4-99d1b4ffbc26 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1757 microversion: 2.1 time: 0.166867 Feb 15 04:26:51.051198 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 393/757] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:26:50 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:56.955532 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:56.956151 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:56.962311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:56.962750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:56.963519 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:56.963949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:56.992978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b2035b0b-50b3-4d86-ad0f-6a97a244e75a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments/45f533aa-6103-4e15-b469-c74c7d0b8fae" status: 200 len: 194 microversion: 2.20 time: 0.041620 Feb 15 04:26:56.993481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 365/758] 10.222.0.45 () {60 vars in 1453 bytes} [Tue Feb 15 04:26:56 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments/45f533aa-6103-4e15-b469-c74c7d0b8fae => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:26:57.054782 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:57.055353 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:57.061704 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:57.062154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:57.063628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:57.064067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:57.155777 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lazy-loading 'services' on Instance uuid 6bfde5a4-3494-4123-b1d1-aa408427983a {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:26:57.237095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7a6f2310-ca02-464b-85b9-8816cdc45151 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments/45f533aa-6103-4e15-b469-c74c7d0b8fae" status: 202 len: 0 microversion: 2.20 time: 0.185844 Feb 15 04:26:57.237716 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 394/759] 10.222.0.45 () {60 vars in 1456 bytes} [Tue Feb 15 04:26:57 2022] DELETE /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments/45f533aa-6103-4e15-b469-c74c7d0b8fae => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:26:57.246428 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:57.247290 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:57.254238 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:57.254687 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:57.255481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:57.255921 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:57.287285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-61ecece0-ea66-4138-a61c-9331d738b0bc tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044708 Feb 15 04:26:57.287909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 366/760] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Feb 15 04:26:57 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:26:58.300297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:58.301382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:58.307743 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:58.308125 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:58.308920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:58.309378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:58.338901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0baddf78-f6cd-48f8-a17c-d24ef45de39d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043398 Feb 15 04:26:58.339458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 395/761] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Feb 15 04:26:58 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:26:58.396181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:58.396684 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:58.402925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:58.403373 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:58.404144 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:58.404574 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:58.429283 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:26:58.503532 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-81b23b81-9996-41a9-9f1c-e4b45d598e18 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 204 len: 0 microversion: 2.20 time: 0.110704 Feb 15 04:26:58.504134 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 367/762] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Feb 15 04:26:58 2022] DELETE /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 04:26:58.513145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:58.513873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:58.520589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:58.521080 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:58.521869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:58.522302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:58.654396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:58.662884 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:58.664362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:58.665539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-69c17ccb-9ae9-4154-beda-3bafed39adf3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.156314 Feb 15 04:26:58.666091 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 396/763] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:26:58 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:26:59.684491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:26:59.685218 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:26:59.693750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:59.694194 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:59.694997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:26:59.696705 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:26:59.845840 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:59.854356 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:59.855828 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:26:59.856987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9e27f816-2fdd-4300-9034-b4d2e4b62129 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.176713 Feb 15 04:26:59.857540 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 368/764] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:26:59 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:00.878031 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:00.878668 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:00.885494 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:00.886523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:00.886731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:00.887159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:01.028787 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:01.038292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:01.040026 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:01.041239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b4f0e321-844c-41da-aaab-bd15445b9c9d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 200 len: 1723 microversion: 2.20 time: 0.168441 Feb 15 04:27:01.042028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 397/765] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:00 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:01.504067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-50b7cdeb-a672-4be9-adad-5b6bcb5a2521 req-8ea5570a-fad4-4cae-ba2f-c14681138c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfde5a4-3494-4123-b1d1-aa408427983a", "name": "network-vif-deleted", "tag": "363efce2-a87d-4ada-a63b-669f59236698"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:01.505922 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:01.505922 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:27:01.517863 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-50b7cdeb-a672-4be9-adad-5b6bcb5a2521 req-8ea5570a-fad4-4cae-ba2f-c14681138c78 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:01.519028 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-50b7cdeb-a672-4be9-adad-5b6bcb5a2521 req-8ea5570a-fad4-4cae-ba2f-c14681138c78 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:01.535657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-50b7cdeb-a672-4be9-adad-5b6bcb5a2521 req-8ea5570a-fad4-4cae-ba2f-c14681138c78 service nova] Creating event network-vif-deleted:363efce2-a87d-4ada-a63b-669f59236698 for instance 6bfde5a4-3494-4123-b1d1-aa408427983a on hv-cinder-81610 Feb 15 04:27:01.542067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-50b7cdeb-a672-4be9-adad-5b6bcb5a2521 req-8ea5570a-fad4-4cae-ba2f-c14681138c78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043120 Feb 15 04:27:01.543150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 369/766] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:27:02.061195 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:02.062583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:02.070494 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:02.071233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:02.072024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:02.072454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:02.086683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] HTTP exception thrown: Instance 6bfde5a4-3494-4123-b1d1-aa408427983a could not be found. Feb 15 04:27:02.087301 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Returning 404 to user: Instance 6bfde5a4-3494-4123-b1d1-aa408427983a could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:27:02.088303 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1bb0e824-f4eb-45a8-ba95-cb93d91c2dc2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 404 len: 111 microversion: 2.20 time: 0.031533 Feb 15 04:27:02.089217 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 398/767] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:02 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:27:02.098334 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-81433923-10c0-42f1-9431-f09e603399c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '.version_select at 0x7fc5d5c4a820>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:02.123780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-81433923-10c0-42f1-9431-f09e603399c2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090852241" status: 204 len: 0 microversion: 2.20 time: 0.029666 Feb 15 04:27:02.124582 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 370/768] 10.222.0.45 () {60 vars in 1261 bytes} [Tue Feb 15 04:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090852241 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 04:27:02.868295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-62623f1f-8047-48be-82d5-121b83565a4e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'create', calling method: .version_select at 0x7fc5d5b40f70>, body: {"keypair": {"name": "tempest-keypair-754600533"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:02.883611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-62623f1f-8047-48be-82d5-121b83565a4e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:27:02.887642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-62623f1f-8047-48be-82d5-121b83565a4e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for user 246b8f1d109749f3a8cf3da973aacaac and project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:27:03.216326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-62623f1f-8047-48be-82d5-121b83565a4e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:27:03.222016 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-62623f1f-8047-48be-82d5-121b83565a4e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for user 246b8f1d109749f3a8cf3da973aacaac and project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:27:03.247421 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-62623f1f-8047-48be-82d5-121b83565a4e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.383558 Feb 15 04:27:03.256505 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 399/769] 10.222.0.45 () {62 vars in 1198 bytes} [Tue Feb 15 04:27:02 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 385 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 15 04:27:04.982799 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-649953130", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0c3e2a8-7b6d-47b3-b743-56e894a4b50d"}], "security_groups": [{"name": "tempest-securitygroup--1634562563"}], "key_name": "tempest-keypair-754600533", "user_data": "}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:05.130359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] validate_networks() for [('f0c3e2a8-7b6d-47b3-b743-56e894a4b50d', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:27:05.533098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:27:05.533651 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:27:05.534240 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:27:05.534745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:27:05.535250 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:27:05.545300 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:05.545740 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:05.546547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:05.547794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:05.567032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:27:05.571995 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Getting quotas for user 246b8f1d109749f3a8cf3da973aacaac and project b6908f5f033f4c8888210c0cf405f4fa. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:27:05.589059 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:27:05.591730 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:27:05.643165 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-675df8e2-3c69-44b8-858f-96df8faa94d8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.669204 Feb 15 04:27:05.644268 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 371/770] 10.222.0.45 () {62 vars in 1187 bytes} [Tue Feb 15 04:27:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 15 04:27:05.654387 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3faefccb-c7ad-491f-a05d-decfdff3e2e3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:05.654986 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3faefccb-c7ad-491f-a05d-decfdff3e2e3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:05.735383 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3faefccb-c7ad-491f-a05d-decfdff3e2e3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:05.743745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3faefccb-c7ad-491f-a05d-decfdff3e2e3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:05.745415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3faefccb-c7ad-491f-a05d-decfdff3e2e3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:05.746693 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3faefccb-c7ad-491f-a05d-decfdff3e2e3 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1280 microversion: 2.20 time: 0.096171 Feb 15 04:27:05.747345 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 400/771] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:05 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:06.768623 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:06.769343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:06.776253 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:06.776782 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:06.777656 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:06.778159 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:06.849665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:06.857411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:06.858906 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:06.860041 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-aa7aef21-976c-4eda-af3d-dca60d8a6d09 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1338 microversion: 2.20 time: 0.096619 Feb 15 04:27:06.860589 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 372/772] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:06 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:07.878737 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:07.879444 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:07.885826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:07.886279 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:07.887070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:07.887501 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:07.978438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-52c9fedd-5cb7-4ca1-a3b5-7698248d1121 req-1c315c09-b464-41ad-99a4-f90c8639c82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:07.980313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:07.980313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:27:07.990024 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-52c9fedd-5cb7-4ca1-a3b5-7698248d1121 req-1c315c09-b464-41ad-99a4-f90c8639c82d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:07.990470 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-52c9fedd-5cb7-4ca1-a3b5-7698248d1121 req-1c315c09-b464-41ad-99a4-f90c8639c82d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:08.009909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-52c9fedd-5cb7-4ca1-a3b5-7698248d1121 req-1c315c09-b464-41ad-99a4-f90c8639c82d service nova] Creating event network-changed:9f6ba102-729f-4db0-85bd-4f490aab77db for instance 8003b584-f389-4058-8718-5e3ca7015245 on hv-cinder-81610 Feb 15 04:27:08.014836 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-52c9fedd-5cb7-4ca1-a3b5-7698248d1121 req-1c315c09-b464-41ad-99a4-f90c8639c82d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039947 Feb 15 04:27:08.016597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 373/773] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:27:08.053185 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:08.062434 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:08.066285 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:08.067460 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9646c6ff-6b30-481a-b05c-b03c9bf5d9a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.193051 Feb 15 04:27:08.068339 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 401/774] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:07 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:27:09.086471 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:09.087265 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:09.093441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:09.093925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:09.095058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:09.095494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:09.278843 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:09.287163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:09.288688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:09.289809 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4ebf28b7-5986-41cf-bbb9-be856d69fd39 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.207937 Feb 15 04:27:09.290369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 374/775] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:09 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:10.307392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:10.307977 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:10.315241 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:10.315688 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:10.316461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:10.316936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:10.452271 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:10.460225 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:10.461751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:10.462845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-89fa6c24-b6e8-40da-9e3d-ebbfcf63cb2e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.159163 Feb 15 04:27:10.463399 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 402/776] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:10 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:11.480234 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:11.480833 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:11.487543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:11.487993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:11.488796 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:11.489251 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:11.627281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:11.635435 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:11.637269 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:11.638367 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-24620f98-255d-4c73-bbcf-f67198b75b1c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.161794 Feb 15 04:27:11.638915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 375/777] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:11 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:12.659574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:12.660652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:12.668340 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:12.668791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:12.669677 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:12.670151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:12.818984 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:12.827392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:12.830069 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:12.831307 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1306c8fe-562d-4b3a-af9d-52ae3931277f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.178219 Feb 15 04:27:12.831810 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 403/778] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:12 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:13.850288 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:13.850893 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:13.857627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:13.858125 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:13.858910 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:13.859943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:13.999876 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:14.008093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:14.009610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:14.011421 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0b52d0df-0bc9-45d8-85c7-e613b69ffd07 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.164469 Feb 15 04:27:14.011421 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 376/779] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:13 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:14.481714 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-defa987f-7251-43ff-9810-ebdee460b040 req-e7f6ee52-5e50-4d4c-aa41-d7ae159afece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "name": "network-vif-plugged", "status": "completed", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:14.483796 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:14.483796 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:27:14.495498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-defa987f-7251-43ff-9810-ebdee460b040 req-e7f6ee52-5e50-4d4c-aa41-d7ae159afece service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:14.495853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-defa987f-7251-43ff-9810-ebdee460b040 req-e7f6ee52-5e50-4d4c-aa41-d7ae159afece service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:14.510237 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-defa987f-7251-43ff-9810-ebdee460b040 req-e7f6ee52-5e50-4d4c-aa41-d7ae159afece service nova] Creating event network-vif-plugged:9f6ba102-729f-4db0-85bd-4f490aab77db for instance 8003b584-f389-4058-8718-5e3ca7015245 on hv-cinder-81610 Feb 15 04:27:14.515357 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-defa987f-7251-43ff-9810-ebdee460b040 req-e7f6ee52-5e50-4d4c-aa41-d7ae159afece service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038028 Feb 15 04:27:14.516186 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 404/780] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:27:15.030364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:15.030969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:15.038798 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:15.039249 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:15.040048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:15.040479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:15.185871 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:15.194085 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:15.195583 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:15.196688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5a8c8455-4c7b-47cf-8f9e-3ec57498dc5f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.170072 Feb 15 04:27:15.197273 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 377/781] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:15 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:16.215766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:16.216455 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:16.223942 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:16.224388 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:16.225216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:16.225647 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:16.376533 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:16.384506 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:16.386061 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:16.387165 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-26df69e0-0f34-4d34-92d3-3879b3df1a88 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1406 microversion: 2.20 time: 0.176275 Feb 15 04:27:16.387724 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 405/782] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:16 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:17.405749 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:17.406647 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:17.413664 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:17.414309 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:17.415332 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:17.415832 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:17.555236 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:17.564464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:17.566005 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:17.567169 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d3d190e9-e116-4e28-9829-304fb2f199ed tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1598 microversion: 2.20 time: 0.165193 Feb 15 04:27:17.567734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 378/783] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:27:17 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:27:17.587150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:17.588002 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:17.598736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:17.599508 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:17.600913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:17.601689 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:17.688729 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8dca061e-6d8f-40ef-935d-f5b2bfc4520f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107273 Feb 15 04:27:17.689477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 406/784] 10.222.0.45 () {60 vars in 1315 bytes} [Tue Feb 15 04:27:17 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:27:18.697030 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:18.698331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:18.699819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-19f73fda-0399-40f7-8fcb-664605b8731c req-005c91e1-f283-4385-bc4a-c02fb9160ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:18.702147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:18.702147 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:27:18.705675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:18.706121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:18.707171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:18.707766 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:18.710022 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-19f73fda-0399-40f7-8fcb-664605b8731c req-005c91e1-f283-4385-bc4a-c02fb9160ec7 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:18.710753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-19f73fda-0399-40f7-8fcb-664605b8731c req-005c91e1-f283-4385-bc4a-c02fb9160ec7 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:18.723276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-19f73fda-0399-40f7-8fcb-664605b8731c req-005c91e1-f283-4385-bc4a-c02fb9160ec7 service nova] Creating event network-changed:9f6ba102-729f-4db0-85bd-4f490aab77db for instance 8003b584-f389-4058-8718-5e3ca7015245 on hv-cinder-81610 Feb 15 04:27:18.731185 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-19f73fda-0399-40f7-8fcb-664605b8731c req-005c91e1-f283-4385-bc4a-c02fb9160ec7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035258 Feb 15 04:27:18.733267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 407/785] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:27:18.733417 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-00eb4e55-5c8b-4391-a660-9a5dca28b2c4 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/ips" status: 200 len: 112 microversion: 2.20 time: 0.040037 Feb 15 04:27:18.739087 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 379/786] 10.222.0.45 () {60 vars in 1288 bytes} [Tue Feb 15 04:27:18 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/ips => generated 112 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:27:38.501982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:38.503008 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:38.509155 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:38.509612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:38.510993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:38.510993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:38.541111 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4768ffef-5aa9-41cf-ae3f-87d73a27c258 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044212 Feb 15 04:27:38.541973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 408/787] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:27:38 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:27:38.597705 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:38.598232 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:38.604034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:38.604478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:38.605287 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:38.605782 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:38.630909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:27:38.705482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-29854cc2-093e-48d5-a829-d7b469ffab4a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 204 len: 0 microversion: 2.1 time: 0.111365 Feb 15 04:27:38.706402 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 380/788] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:27:38 2022] DELETE /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:27:38.716139 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:38.716805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:38.723574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:38.723746 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:38.724531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:38.725004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:38.859700 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:38.867427 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-187ed55b-e9d7-488b-9e1b-3853e685e871 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1673 microversion: 2.1 time: 0.156285 Feb 15 04:27:38.867996 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 409/789] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:38 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:27:39.885785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:39.886475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:39.893240 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:39.893681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:39.894466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:39.894890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:40.035947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:40.043233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7de6c5af-aa1a-4e19-b3e1-ce08080ee12a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1673 microversion: 2.1 time: 0.161513 Feb 15 04:27:40.043800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 381/790] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:39 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:41.019656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-4613084f-cb6b-412e-a99c-055e23e47fe8 req-bc7c5277-0997-4311-9cf6-572b15f67b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda24f72-ec24-4b2a-9eed-23dbe8b9706c", "name": "network-vif-deleted", "tag": "cef1beba-9166-4527-9646-13388dc57d5b"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:41.021819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:41.021819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:27:41.038571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-4613084f-cb6b-412e-a99c-055e23e47fe8 req-bc7c5277-0997-4311-9cf6-572b15f67b7c service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:41.039046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-4613084f-cb6b-412e-a99c-055e23e47fe8 req-bc7c5277-0997-4311-9cf6-572b15f67b7c service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:41.054903 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-4613084f-cb6b-412e-a99c-055e23e47fe8 req-bc7c5277-0997-4311-9cf6-572b15f67b7c service nova] Creating event network-vif-deleted:cef1beba-9166-4527-9646-13388dc57d5b for instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c on hv-cinder-81610 Feb 15 04:27:41.059208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-4613084f-cb6b-412e-a99c-055e23e47fe8 req-bc7c5277-0997-4311-9cf6-572b15f67b7c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043740 Feb 15 04:27:41.060367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 410/791] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:27:41.060499 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:41.065053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:41.076098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:41.076644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:41.080239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:41.080714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:41.159748 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:41.171632 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-67f44698-76d9-4c53-a831-e46ff6650f94 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 200 len: 1321 microversion: 2.1 time: 0.115213 Feb 15 04:27:41.172604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 382/792] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:41 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 1321 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:42.190035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:42.190722 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:42.197142 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:42.197595 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:42.198366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:42.198796 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:42.212278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] HTTP exception thrown: Instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c could not be found. Feb 15 04:27:42.212783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Returning 404 to user: Instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:27:42.213628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1cdda0f5-92b9-44f1-9a1f-758979db4d11 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 404 len: 111 microversion: 2.1 time: 0.028647 Feb 15 04:27:42.214152 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 411/793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:42 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:27:42.222481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f16d23f9-b873-4221-b632-bf865cafd2bb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '.version_select at 0x7fc5d5ca5dc0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:42.239504 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f16d23f9-b873-4221-b632-bf865cafd2bb tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884644280" status: 202 len: 0 microversion: 2.1 time: 0.020634 Feb 15 04:27:42.240320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 383/794] 10.222.0.45 () {58 vars in 1217 bytes} [Tue Feb 15 04:27:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884644280 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:27:42.884500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e36e6ac6-2c6c-4dd3-9473-7de2bcb55707 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: .version_select at 0x7fc5d5c91040>, body: {"keypair": {"name": "tempest-keypair-1303299778"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:42.898146 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-e36e6ac6-2c6c-4dd3-9473-7de2bcb55707 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:27:42.901919 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-e36e6ac6-2c6c-4dd3-9473-7de2bcb55707 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for user 6ae6b80b4cb946208c461caebad57faa and project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:27:43.000841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-e36e6ac6-2c6c-4dd3-9473-7de2bcb55707 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:27:43.004523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-e36e6ac6-2c6c-4dd3-9473-7de2bcb55707 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for user 6ae6b80b4cb946208c461caebad57faa and project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:27:43.017676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e36e6ac6-2c6c-4dd3-9473-7de2bcb55707 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.136893 Feb 15 04:27:43.018253 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 412/795] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Feb 15 04:27:42 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:44.313047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1666718452", "imageRef": "741574c1-c524-4c48-987b-1c9d69bd5dbd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c49ed967-4df2-4c03-a3f7-11bc631a5279"}], "security_groups": [{"name": "tempest-securitygroup--1756330136"}], "key_name": "tempest-keypair-1303299778", "user_data": "}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:44.420690 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] validate_networks() for [('c49ed967-4df2-4c03-a3f7-11bc631a5279', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:27:44.782464 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:27:44.782887 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:27:44.783378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:27:44.783783 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:27:44.784216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:27:44.792843 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:44.793318 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:44.794114 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:44.794540 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:44.811598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:27:44.816268 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Getting quotas for user 6ae6b80b4cb946208c461caebad57faa and project e4ef5a0f7e5040c0aa3d33d31fbbb206. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:27:44.827063 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:27:44.829562 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741574c1-c524-4c48-987b-1c9d69bd5dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:27:44.878700 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7a3aa00c-4050-4de3-bbbf-1bee3266352f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570910 Feb 15 04:27:44.879530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 384/796] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:27:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:27:44.889878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b7743c4e-bc7b-4446-bb9c-b0fe9d9d9063 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:44.890636 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b7743c4e-bc7b-4446-bb9c-b0fe9d9d9063 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:44.945957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b7743c4e-bc7b-4446-bb9c-b0fe9d9d9063 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:44.953709 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b7743c4e-bc7b-4446-bb9c-b0fe9d9d9063 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1238 microversion: 2.1 time: 0.068074 Feb 15 04:27:44.954389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 413/797] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:44 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:27:45.970983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2c8da1e1-cd66-410e-ad4c-e19326f0e000 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:45.971704 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2c8da1e1-cd66-410e-ad4c-e19326f0e000 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:46.029895 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2c8da1e1-cd66-410e-ad4c-e19326f0e000 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:46.036778 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2c8da1e1-cd66-410e-ad4c-e19326f0e000 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1238 microversion: 2.1 time: 0.070149 Feb 15 04:27:46.037368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 385/798] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:45 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:47.053318 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e32f72e0-5b30-4879-9de4-3ff7b847ebc9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:47.053936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e32f72e0-5b30-4879-9de4-3ff7b847ebc9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:47.110760 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e32f72e0-5b30-4879-9de4-3ff7b847ebc9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:47.117706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e32f72e0-5b30-4879-9de4-3ff7b847ebc9 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1238 microversion: 2.1 time: 0.067991 Feb 15 04:27:47.118252 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 414/799] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:47 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:48.134597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b0bf3c6e-2e50-46f5-9b2a-7c0bc9ac455a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:48.135193 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b0bf3c6e-2e50-46f5-9b2a-7c0bc9ac455a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:48.191110 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b0bf3c6e-2e50-46f5-9b2a-7c0bc9ac455a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:48.197679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b0bf3c6e-2e50-46f5-9b2a-7c0bc9ac455a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1238 microversion: 2.1 time: 0.066684 Feb 15 04:27:48.198242 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 386/800] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:48 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:49.214629 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:49.215279 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:49.222255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:49.222703 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:49.223475 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:49.223906 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:49.287859 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:49.296215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9e2696f7-7b27-4093-832a-d544772fa760 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1242 microversion: 2.1 time: 0.085131 Feb 15 04:27:49.296791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 415/801] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:49 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:50.313448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:50.314014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:50.320769 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:50.321245 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:50.322039 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:50.322479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:50.388455 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:50.396409 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-692f9d8c-61d6-4faf-8d24-fc456b098211 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1296 microversion: 2.1 time: 0.086732 Feb 15 04:27:50.397010 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 387/802] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:50 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:51.414256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:51.414878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:51.427396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:51.428035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:51.429245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:51.429770 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:51.487550 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-15f39a04-0d07-4043-a821-15893035a401 req-37a7936d-2ef1-41b2-a9bb-587de9146b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e88377-792d-40c9-9e30-6e1cf6b1017c", "tag": "4f19fadb-80cd-49f6-af86-3c319fa31401"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:51.489209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:51.489209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:27:51.505202 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-15f39a04-0d07-4043-a821-15893035a401 req-37a7936d-2ef1-41b2-a9bb-587de9146b35 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:51.505714 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-15f39a04-0d07-4043-a821-15893035a401 req-37a7936d-2ef1-41b2-a9bb-587de9146b35 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:51.526702 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-15f39a04-0d07-4043-a821-15893035a401 req-37a7936d-2ef1-41b2-a9bb-587de9146b35 service nova] Creating event network-changed:4f19fadb-80cd-49f6-af86-3c319fa31401 for instance 27e88377-792d-40c9-9e30-6e1cf6b1017c on hv-cinder-81610 Feb 15 04:27:51.532466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-15f39a04-0d07-4043-a821-15893035a401 req-37a7936d-2ef1-41b2-a9bb-587de9146b35 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048649 Feb 15 04:27:51.536833 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 388/803] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:27:51.785023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:51.792483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2886761d-43bf-40c7-bad8-15b052db5e9d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1364 microversion: 2.1 time: 0.381885 Feb 15 04:27:51.793052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 416/804] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:51 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1364 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:52.810709 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:52.811408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:52.817744 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:52.818207 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:52.818988 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:52.819426 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:52.951314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:52.959431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cd8d60f9-8580-461e-a02a-19fc49f7a433 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1364 microversion: 2.1 time: 0.153414 Feb 15 04:27:52.959991 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 389/805] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:52 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:53.976336 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:53.976937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:53.984451 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:53.984922 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:53.985763 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:53.986271 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:54.131421 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:54.138957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-75f5f94e-e809-482a-9ed5-29ad729d4766 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1364 microversion: 2.1 time: 0.166302 Feb 15 04:27:54.139574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 417/806] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:53 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:54.683691 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-992098777"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:54.684294 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:54.693391 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:54.694264 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:54.695813 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:54.696629 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:54.846158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.network.security_group_api [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Removing security group 280d7089-d43b-4bbb-bba3-b15d265c64ac from port 40ec21d0-c71c-4bbb-ae5d-68d36612fd1a Feb 15 04:27:55.156725 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:55.158259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:55.166014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:55.166469 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:55.167265 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:55.167923 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:55.190678 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-af27bbdd-7fa4-4107-80d1-5ff1937230ac tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/action" status: 202 len: 0 microversion: 2.1 time: 0.510740 Feb 15 04:27:55.191285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 390/807] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:27:54 2022] POST /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:27:55.203738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-56afbf30-10ef-4b3d-9ccd-29fefda9c9f1 req-3ea1cf79-02db-446e-ab77-9e70dfda4f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:55.207460 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:55.207460 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:27:55.221863 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-56afbf30-10ef-4b3d-9ccd-29fefda9c9f1 req-3ea1cf79-02db-446e-ab77-9e70dfda4f2f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:55.222316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-56afbf30-10ef-4b3d-9ccd-29fefda9c9f1 req-3ea1cf79-02db-446e-ab77-9e70dfda4f2f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:55.240316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-56afbf30-10ef-4b3d-9ccd-29fefda9c9f1 req-3ea1cf79-02db-446e-ab77-9e70dfda4f2f service nova] Creating event network-changed:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:27:55.246961 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-56afbf30-10ef-4b3d-9ccd-29fefda9c9f1 req-3ea1cf79-02db-446e-ab77-9e70dfda4f2f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046551 Feb 15 04:27:55.247781 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 391/808] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:27:55.505502 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:55.522731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2a2f70c4-0cd3-4662-9fe5-1987fb064e0d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1364 microversion: 2.1 time: 0.369554 Feb 15 04:27:55.523762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 418/809] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:55 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:27:56.541725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:56.543237 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:56.550879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.551330 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.552109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.552672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.666275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:56.667504 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:56.676006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.676546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.677458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.677976 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.737304 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:56.745133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5ffdf9d8-d0a7-4311-87bb-e56e016242b2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1364 microversion: 2.1 time: 0.209133 Feb 15 04:27:56.746046 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 392/810] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:56 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:56.774826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lazy-loading 'services' on Instance uuid 65eb5ac6-8758-409e-8494-5b9228b8de6f {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:27:56.841190 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-52ae35bb-7c0d-4bc0-b84b-73ff33ded224 req-6936d376-abe5-4320-8533-1ef47860b29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e88377-792d-40c9-9e30-6e1cf6b1017c", "name": "network-vif-plugged", "status": "completed", "tag": "4f19fadb-80cd-49f6-af86-3c319fa31401"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:56.842855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:56.842855 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:27:56.850543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-52ae35bb-7c0d-4bc0-b84b-73ff33ded224 req-6936d376-abe5-4320-8533-1ef47860b29d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.850993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-52ae35bb-7c0d-4bc0-b84b-73ff33ded224 req-6936d376-abe5-4320-8533-1ef47860b29d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.851407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-611b6e3c-56e4-47f1-87ff-1f01e5773817 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments/40a211b4-e2ae-4f8a-885b-ace6f64272e6" status: 202 len: 0 microversion: 2.1 time: 0.188653 Feb 15 04:27:56.852416 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 419/811] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:27:56 2022] DELETE /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments/40a211b4-e2ae-4f8a-885b-ace6f64272e6 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 04:27:56.862920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:56.863981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:56.871880 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.872637 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.873672 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-52ae35bb-7c0d-4bc0-b84b-73ff33ded224 req-6936d376-abe5-4320-8533-1ef47860b29d service nova] Creating event network-vif-plugged:4f19fadb-80cd-49f6-af86-3c319fa31401 for instance 27e88377-792d-40c9-9e30-6e1cf6b1017c on hv-cinder-81610 Feb 15 04:27:56.873905 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:56.874354 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:56.883961 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-52ae35bb-7c0d-4bc0-b84b-73ff33ded224 req-6936d376-abe5-4320-8533-1ef47860b29d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044379 Feb 15 04:27:56.885072 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 393/812] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:27:56.907992 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c6079a51-307a-4dfc-8b86-20d2682b0b25 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049678 Feb 15 04:27:56.912500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 420/813] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:27:56 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:27:57.264022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-04b2aacf-0eba-451f-9ecc-4a8987c0ecba req-20b37796-0d84-47da-b5c3-d035a8fedc2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:27:57.265545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:27:57.265545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:27:57.272981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-04b2aacf-0eba-451f-9ecc-4a8987c0ecba req-20b37796-0d84-47da-b5c3-d035a8fedc2e service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:57.273440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-04b2aacf-0eba-451f-9ecc-4a8987c0ecba req-20b37796-0d84-47da-b5c3-d035a8fedc2e service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:57.285152 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-04b2aacf-0eba-451f-9ecc-4a8987c0ecba req-20b37796-0d84-47da-b5c3-d035a8fedc2e service nova] Creating event network-changed:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:27:57.290029 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-04b2aacf-0eba-451f-9ecc-4a8987c0ecba req-20b37796-0d84-47da-b5c3-d035a8fedc2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029922 Feb 15 04:27:57.290632 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 394/814] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:27:57.762174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:57.762710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:57.771131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:57.771586 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:57.772382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:57.772821 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:57.920449 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:57.921952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:57.922187 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:57.930507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:57.931231 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4f59bc42-e212-4f8d-9618-718fec6d0410 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1364 microversion: 2.1 time: 0.172703 Feb 15 04:27:57.931397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:57.932119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:57.932561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:57.933234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 421/815] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:57 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:57.969494 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cf0de49d-809f-45b4-ab6a-a7fb27ff3602 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053384 Feb 15 04:27:57.970545 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 395/816] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:27:57 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:27:57.986169 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:57.986811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:57.996810 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:57.998302 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:57.999731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:58.000174 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:58.082010 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] HTTP exception thrown: Instance 65eb5ac6-8758-409e-8494-5b9228b8de6f is not attached to volume 40a211b4-e2ae-4f8a-885b-ace6f64272e6 Feb 15 04:27:58.082611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Returning 404 to user: Instance 65eb5ac6-8758-409e-8494-5b9228b8de6f is not attached to volume 40a211b4-e2ae-4f8a-885b-ace6f64272e6 {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:27:58.083442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-47c7d37d-ca90-4021-8908-47f19c2ec3d4 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments/40a211b4-e2ae-4f8a-885b-ace6f64272e6" status: 404 len: 154 microversion: 2.1 time: 0.107150 Feb 15 04:27:58.084006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 422/817] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:27:57 2022] DELETE /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f/os-volume_attachments/40a211b4-e2ae-4f8a-885b-ace6f64272e6 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:27:58.948329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:58.948979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:58.955977 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:58.956419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:58.957223 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:58.957653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.220403 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:59.221115 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:59.227559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:59.228004 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.228783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:59.229244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.254730 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:27:59.265191 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:59.273256 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ce38fe11-dc11-432e-a741-5d26a4a8c9ab tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1551 microversion: 2.1 time: 0.328458 Feb 15 04:27:59.273830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 396/818] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:58 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1551 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:27:59.289189 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:59.289615 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:59.296176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:59.296698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.297503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:59.297931 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.334881 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f23c9922-4ae9-4cc4-b29f-8bbdd5dab188 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "DELETE /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 204 len: 0 microversion: 2.1 time: 0.117214 Feb 15 04:27:59.335888 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 423/819] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:27:59 2022] DELETE /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 04:27:59.345023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:27:59.345755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:27:59.351667 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:59.352117 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.352929 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:27:59.353485 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:27:59.389249 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1a62d199-53e6-47eb-899f-5f552f56d2b5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103562 Feb 15 04:27:59.389847 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 397/820] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Feb 15 04:27:59 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:27:59.490563 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:27:59.498094 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-68fda189-6eb8-48dc-9485-fad45464019c tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1553 microversion: 2.1 time: 0.157462 Feb 15 04:27:59.498670 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 424/821] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:27:59 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:00.351598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:00.352173 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:00.353775 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-00441a88-abca-41e9-bbbe-30f0bec697be req-41b80c76-89be-4767-aea1-bb21174834cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e88377-792d-40c9-9e30-6e1cf6b1017c", "tag": "4f19fadb-80cd-49f6-af86-3c319fa31401"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:00.355389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:28:00.355389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:28:00.358238 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:00.358692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:00.359474 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:00.359910 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:00.362950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-00441a88-abca-41e9-bbbe-30f0bec697be req-41b80c76-89be-4767-aea1-bb21174834cf service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:00.363454 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-00441a88-abca-41e9-bbbe-30f0bec697be req-41b80c76-89be-4767-aea1-bb21174834cf service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:00.375062 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-00441a88-abca-41e9-bbbe-30f0bec697be req-41b80c76-89be-4767-aea1-bb21174834cf service nova] Creating event network-changed:4f19fadb-80cd-49f6-af86-3c319fa31401 for instance 27e88377-792d-40c9-9e30-6e1cf6b1017c on hv-cinder-81610 Feb 15 04:28:00.381019 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-00441a88-abca-41e9-bbbe-30f0bec697be req-41b80c76-89be-4767-aea1-bb21174834cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Feb 15 04:28:00.382042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 425/822] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:00.385624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dd0a256d-75e6-4682-ba37-b7004a677be5 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/ips" status: 200 len: 107 microversion: 2.1 time: 0.038057 Feb 15 04:28:00.386493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 398/823] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:28:00 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/ips => generated 107 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:00.516648 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:00.518715 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:00.527930 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:00.528664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:00.530574 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:00.531260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:00.759461 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:00.768274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-49922264-cf8e-48b7-abad-0a5b38f4d891 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1553 microversion: 2.1 time: 0.256092 Feb 15 04:28:00.773008 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 426/824] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:00 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:01.757845 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c513e7c4-cfe0-41db-8d71-5b937488299c"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:01.758907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:01.765130 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:01.765581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:01.766364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:01.766797 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:01.786220 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:01.786851 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:01.792936 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:01.793392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:01.794245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:01.794690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:01.974057 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94835c1fe2b64e06b994878d1143ed54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d87f4f4ed448f8d45c85f92cf1462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:01.981864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d078882e-a443-469a-97a3-a756ed309c5f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 200 len: 1553 microversion: 2.1 time: 0.199944 Feb 15 04:28:01.982648 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 427/825] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:01 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:02.046543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1e1b1268-f151-47c3-89bb-4d0e6abfd94b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292212 Feb 15 04:28:02.047152 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 399/826] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:28:01 2022] POST /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:02.398735 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-d5c4e703-1d80-4dfb-8106-09f2ab20b5c0 req-e928433e-c0ce-47e4-a650-706ff5798247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eb5ac6-8758-409e-8494-5b9228b8de6f", "name": "network-vif-deleted", "tag": "40ec21d0-c71c-4bbb-ae5d-68d36612fd1a"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:02.400991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:28:02.400991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:28:02.409006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-d5c4e703-1d80-4dfb-8106-09f2ab20b5c0 req-e928433e-c0ce-47e4-a650-706ff5798247 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:02.409827 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-d5c4e703-1d80-4dfb-8106-09f2ab20b5c0 req-e928433e-c0ce-47e4-a650-706ff5798247 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:02.422603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-d5c4e703-1d80-4dfb-8106-09f2ab20b5c0 req-e928433e-c0ce-47e4-a650-706ff5798247 service nova] Creating event network-vif-deleted:40ec21d0-c71c-4bbb-ae5d-68d36612fd1a for instance 65eb5ac6-8758-409e-8494-5b9228b8de6f on hv-cinder-81610 Feb 15 04:28:02.430251 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-d5c4e703-1d80-4dfb-8106-09f2ab20b5c0 req-e928433e-c0ce-47e4-a650-706ff5798247 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037780 Feb 15 04:28:02.431677 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 428/827] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:03.000056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:03.000666 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] [instance: 65eb5ac6-8758-409e-8494-5b9228b8de6f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:03.007428 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:03.007878 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:03.008657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:03.009136 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:03.021965 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] HTTP exception thrown: Instance 65eb5ac6-8758-409e-8494-5b9228b8de6f could not be found. Feb 15 04:28:03.022466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Returning 404 to user: Instance 65eb5ac6-8758-409e-8494-5b9228b8de6f could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:28:03.023281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-665e6bd6-35f6-4c2f-8337-913d57fc6ec7 tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f" status: 404 len: 111 microversion: 2.1 time: 0.027799 Feb 15 04:28:03.023808 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 400/828] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:02 2022] GET /compute/v2.1/servers/65eb5ac6-8758-409e-8494-5b9228b8de6f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:28:03.033146 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-66ed8ad2-ece0-49b0-9242-0739dacd100f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] Calling method '.version_select at 0x7fc5d5c91b80>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:03.052785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-66ed8ad2-ece0-49b0-9242-0739dacd100f tempest-TestMinimumBasicScenario-1458480958 tempest-TestMinimumBasicScenario-1458480958-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463541621" status: 202 len: 0 microversion: 2.1 time: 0.024326 Feb 15 04:28:03.053556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 429/829] 10.222.0.45 () {58 vars in 1268 bytes} [Tue Feb 15 04:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463541621 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:28:09.534320 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:09.535305 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:09.541697 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:09.542156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:09.542942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:09.543385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:09.575630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c88652b7-0e01-4a23-b74c-badabd5d3e9c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Feb 15 04:28:09.576193 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 401/830] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:28:09 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:09.586750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:09.587358 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:09.594018 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:09.594474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:09.596643 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:09.597462 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:09.630838 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-30ce1c58-8167-4424-8bed-916efd95840c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/c513e7c4-cfe0-41db-8d71-5b937488299c" status: 200 len: 194 microversion: 2.1 time: 0.048472 Feb 15 04:28:09.631449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 430/831] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Feb 15 04:28:09 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/c513e7c4-cfe0-41db-8d71-5b937488299c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:11.026568 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "accc892c-6bcb-4559-bbaa-f3b270f3ae70"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:11.028352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:11.038923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:11.039849 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:11.040701 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:11.041198 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:11.277974 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d306dfd4-5969-46cd-b826-12e87b89546a tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "POST /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254927 Feb 15 04:28:11.278845 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 402/832] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Feb 15 04:28:11 2022] POST /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:18.865092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:18.866817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:18.877395 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:18.878248 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:18.879094 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:18.879993 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:18.921157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0136ae78-f454-4d17-a6f8-e7431e89e429 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068216 Feb 15 04:28:18.922456 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 431/833] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:28:18 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:21.395327 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9e90f1ce-1e2d-4981-9668-ea0288d9e300 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Action: 'create', calling method: .version_select at 0x7fc5d5c5e820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-557449170"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:21.412534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-9e90f1ce-1e2d-4981-9668-ea0288d9e300 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:28:21.416624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-9e90f1ce-1e2d-4981-9668-ea0288d9e300 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for user 38c585ad31ef4f50bd695bb379107a9a and project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:28:21.605602 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-9e90f1ce-1e2d-4981-9668-ea0288d9e300 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:28:21.609378 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-9e90f1ce-1e2d-4981-9668-ea0288d9e300 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for user 38c585ad31ef4f50bd695bb379107a9a and project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:28:21.625499 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9e90f1ce-1e2d-4981-9668-ea0288d9e300 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.400373 Feb 15 04:28:21.631852 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 403/834] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Feb 15 04:28:21 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:35.201439 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:35.202007 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:35.208611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:35.209107 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:35.209886 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:35.210323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:35.233441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lazy-loading 'flavor' on Instance uuid 8003b584-f389-4058-8718-5e3ca7015245 {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:28:35.486524 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-13fd7845-8261-4098-8652-03a25d0b663e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/action" status: 202 len: 0 microversion: 2.20 time: 0.288821 Feb 15 04:28:35.487286 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 432/835] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Feb 15 04:28:35 2022] POST /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:28:35.495799 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:35.496527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:35.503858 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:35.504310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:35.505163 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:35.505587 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:35.655231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:35.663775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:35.665343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:35.666535 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-10bbd955-919b-4686-a9da-a708b585696f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.174899 Feb 15 04:28:35.667304 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 404/836] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:35 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:28:36.686965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:36.687573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:36.694158 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:36.694611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:36.695411 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:36.695845 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:36.837657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:36.845527 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:36.847017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:36.848163 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-16d8fd69-6158-4bc1-bb3b-8fcca3802693 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.166291 Feb 15 04:28:36.848719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 433/837] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:36 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:37.866728 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:37.867331 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:37.873771 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:37.874217 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:37.874991 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:37.875459 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:38.014584 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:38.022983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:38.024470 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:38.025654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-af18422e-e012-4fa5-aefb-04f203463756 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.163014 Feb 15 04:28:38.026201 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 405/838] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:37 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:28:39.045451 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:39.046065 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:39.053215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:39.053928 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:39.054763 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:39.063458 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:39.209449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:39.217328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:39.219350 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:39.220528 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-28abf146-dd85-4a97-b551-4dc29be226cd tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.178834 Feb 15 04:28:39.221154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 434/839] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:39 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:28:40.240003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:40.240595 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:40.247203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:40.247652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:40.248492 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:40.248992 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:40.387181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:40.395829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:40.397369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:40.398538 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e8f5e710-a510-4686-84b1-e6091ba5951d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.162528 Feb 15 04:28:40.399086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 406/840] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:40 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:41.418083 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:41.418953 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:41.426494 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:41.426941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:41.427719 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:41.428150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:41.592997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:41.601515 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:41.603043 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:41.604250 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2650ae6e-2002-4e08-9b59-23dd3ba9b989 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.189961 Feb 15 04:28:41.604820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 435/841] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:41 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:42.623628 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:42.624267 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:42.631892 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:42.632342 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:42.633187 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:42.633631 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:42.782908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:42.791619 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:42.793156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:42.794369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-48afe612-1622-4d99-8fe4-61c2a0073871 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.174837 Feb 15 04:28:42.794930 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 407/842] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:42 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:43.813344 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:43.813951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:43.820434 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:43.820885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:43.821703 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:43.822134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:43.965737 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:43.974651 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:43.976055 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:43.977235 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-08f944c8-9af1-4a36-b399-c71274766f1b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.167612 Feb 15 04:28:43.977811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 436/843] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:43 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:44.996471 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:44.997057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:45.003588 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:45.004049 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:45.004843 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:45.005313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:45.142091 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:45.150630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:45.152137 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:45.153332 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5369f5d5-735c-4b5b-95c7-17db396a40a5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.160596 Feb 15 04:28:45.153881 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 408/844] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:44 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:46.171478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:46.173139 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:46.180050 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:46.180499 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:46.181390 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:46.181824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:46.294743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-838074874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-557449170", "security_groups": [{"name": "tempest-secgroup-smoke-1039074646"}], "block_device_mapping_v2": [{"uuid": "df645ad8-464d-45ed-bf60-3cd5614edbd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4287db8-7eb1-4b55-9815-94bfd52e6a07"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:46.324134 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:46.334467 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:46.335902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:46.337108 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fbb7c27e-bc43-4bb4-b9e1-3a283c23416a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.169388 Feb 15 04:28:46.337666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 437/845] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:46 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:46.411770 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] validate_networks() for [('a4287db8-7eb1-4b55-9815-94bfd52e6a07', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:28:46.796092 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:28:46.796509 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:28:46.797550 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:28:46.797956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:28:46.798365 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:28:46.807231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:46.807698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:46.808535 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:46.808997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:46.826211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:28:46.831007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for user 38c585ad31ef4f50bd695bb379107a9a and project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:28:46.885186 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:28:46.887325 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df645ad8-464d-45ed-bf60-3cd5614edbd9',volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:28:47.011788 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-03198a54-08cd-4158-add2-7a14effb443b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720646 Feb 15 04:28:47.012422 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 409/846] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:28:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 04:28:47.023089 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d8ec1e97-7fc2-4345-a3e3-7bcd1f14ab21 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:47.023794 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d8ec1e97-7fc2-4345-a3e3-7bcd1f14ab21 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:47.080809 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d8ec1e97-7fc2-4345-a3e3-7bcd1f14ab21 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:47.087772 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d8ec1e97-7fc2-4345-a3e3-7bcd1f14ab21 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1093 microversion: 2.1 time: 0.068404 Feb 15 04:28:47.088365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 438/847] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:47 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:47.355747 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:47.356340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:47.363116 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:47.364033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:47.364818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:47.365281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:47.512780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:47.521650 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:47.523227 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:47.524386 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-aaa92524-446f-44af-b032-ae0e041076e2 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.172799 Feb 15 04:28:47.524956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 410/848] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:47 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:48.105498 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:48.106054 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:48.113280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:48.114017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:48.114798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:48.115239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:48.175634 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:48.182921 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-20965441-d8e1-44ec-8a1e-a14e2e07b381 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1191 microversion: 2.1 time: 0.081192 Feb 15 04:28:48.183486 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 439/849] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:48 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:48.542748 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:48.543362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:48.551522 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:48.552048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:48.552970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:48.553497 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:48.775498 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:48.785967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:48.787440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:48.788686 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-19ac49f5-7f07-44cf-bf7b-e8fe001ba3cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.249820 Feb 15 04:28:48.789262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 411/850] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:48 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:49.200141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:49.200912 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:49.208319 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:49.208836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:49.209710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:49.210166 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:49.355862 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:49.364371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f46b9649-c1a0-416d-80c0-1c4d339651cc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.168130 Feb 15 04:28:49.364984 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 440/851] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:49 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:28:49.806927 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:49.807515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:49.814659 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:49.815137 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:49.815922 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:49.816549 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:50.018946 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-7b8dcbf7-a750-4f3b-9883-5db4f83d5144 req-5c886ce7-9cbb-4165-b9bc-7db7753671e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c35f39-3caa-49f1-9289-7514ba7f3edb", "tag": "6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:50.021657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:28:50.021657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:28:50.029752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-7b8dcbf7-a750-4f3b-9883-5db4f83d5144 req-5c886ce7-9cbb-4165-b9bc-7db7753671e5 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:50.030523 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-7b8dcbf7-a750-4f3b-9883-5db4f83d5144 req-5c886ce7-9cbb-4165-b9bc-7db7753671e5 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:50.053347 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-7b8dcbf7-a750-4f3b-9883-5db4f83d5144 req-5c886ce7-9cbb-4165-b9bc-7db7753671e5 service nova] Creating event network-changed:6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2 for instance d1c35f39-3caa-49f1-9289-7514ba7f3edb on hv-cinder-81610 Feb 15 04:28:50.058977 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-7b8dcbf7-a750-4f3b-9883-5db4f83d5144 req-5c886ce7-9cbb-4165-b9bc-7db7753671e5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044769 Feb 15 04:28:50.059794 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 441/852] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:50.066610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:50.074960 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:50.076444 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:50.077667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-21a50c8a-b373-4817-bff8-bc032c193118 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.274696 Feb 15 04:28:50.079785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 412/853] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:49 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:28:50.381711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:50.382392 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:50.389032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:50.389488 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:50.390307 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:50.391211 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:50.535159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:50.543217 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-78696e37-f561-4549-affa-a7cad165b20c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.165415 Feb 15 04:28:50.543787 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 442/854] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:50 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:51.098303 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:51.098847 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:51.105079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:51.105528 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:51.106303 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:51.106732 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:51.254056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:51.261703 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:51.263207 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:51.264364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ff43c0b4-650d-4b8e-a7b4-1f9574865f78 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.170774 Feb 15 04:28:51.265015 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 413/855] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:51 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:51.560401 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:51.561039 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:51.567391 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:51.567841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:51.568621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:51.569089 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:51.706367 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:51.714848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2d9cf455-225e-44ab-a695-cb2b5541fbac tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.158125 Feb 15 04:28:51.715421 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 443/856] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:51 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:52.281741 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:52.282381 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:52.288665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:52.289150 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:52.289942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:52.290351 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:52.422823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:52.430925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:52.432415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:52.433616 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dbe764a1-cfaf-4636-b648-b07655f54e2a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1744 microversion: 2.20 time: 0.155734 Feb 15 04:28:52.434170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 414/857] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:52 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:52.730588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:52.731197 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:52.738157 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:52.738871 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:52.739647 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:52.740084 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:52.876153 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:52.883708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-95ff8bd1-82a6-4a44-af79-0183bc3212c1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.156749 Feb 15 04:28:52.884273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 444/858] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:52 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:53.452155 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:53.453763 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:53.459818 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:53.460260 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:53.461067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:53.461501 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:53.596717 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:53.605157 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:53.606638 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:53.607795 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6dc301c4-4854-4d5a-bebf-90996e6fee47 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1744 microversion: 2.20 time: 0.159370 Feb 15 04:28:53.608338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 415/859] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:53 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:53.900838 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:53.901512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:53.908277 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:53.908728 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:53.909531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:53.909967 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:54.045490 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:54.053400 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f25d2bd9-561b-4472-8e75-b2724c922a44 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.156252 Feb 15 04:28:54.053956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 445/860] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:53 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:54.627800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:54.628418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:54.634808 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:54.635259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:54.636039 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:54.636475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:54.777358 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:54.785665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:54.787182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:54.788343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-763e0251-d07a-44d4-8e1b-09b7283c76ae tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1744 microversion: 2.20 time: 0.165317 Feb 15 04:28:54.788913 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 416/861] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:54 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:55.060493 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-57748294-f633-4b8b-bbee-64eee536f579 req-de0df162-1cc6-4cfc-8828-ce16cda42eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "name": "network-vif-plugged", "status": "completed", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:28:55.062176 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:28:55.062176 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:28:55.071304 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:55.071928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:55.072325 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-57748294-f633-4b8b-bbee-64eee536f579 req-de0df162-1cc6-4cfc-8828-ce16cda42eb5 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:55.073209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-57748294-f633-4b8b-bbee-64eee536f579 req-de0df162-1cc6-4cfc-8828-ce16cda42eb5 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:55.081509 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:55.081982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:55.082779 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:55.083227 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:55.089374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-57748294-f633-4b8b-bbee-64eee536f579 req-de0df162-1cc6-4cfc-8828-ce16cda42eb5 service nova] Creating event network-vif-plugged:9f6ba102-729f-4db0-85bd-4f490aab77db for instance 8003b584-f389-4058-8718-5e3ca7015245 on hv-cinder-81610 Feb 15 04:28:55.095143 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-57748294-f633-4b8b-bbee-64eee536f579 req-de0df162-1cc6-4cfc-8828-ce16cda42eb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038344 Feb 15 04:28:55.095972 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 446/862] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:28:55.243122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:55.251333 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0baf9bd9-6863-46b4-98c8-230db92aa37d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.183770 Feb 15 04:28:55.251902 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 417/863] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:55 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:28:55.806876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:55.807573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:55.815087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:55.815542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:55.816326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:55.816758 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:55.953029 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:55.962097 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:55.963631 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:55.964818 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-325cef54-0bb5-487a-9774-6f1b40c677e9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1744 microversion: 2.20 time: 0.162137 Feb 15 04:28:55.965418 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 447/864] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:55 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:56.268715 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:56.269343 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:56.276412 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:56.276412 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:56.277175 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:56.277608 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:56.412322 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:56.420230 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-48d147df-bda4-46b7-a306-f30c873bf10d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.155939 Feb 15 04:28:56.420795 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 418/865] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:56 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:56.983018 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:56.983567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:56.990788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:56.991238 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:56.992006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:56.992437 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:57.128740 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:57.136512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:57.138046 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:57.139194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-18753fa7-f4ff-4e09-80b0-53eb50f93c9c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1744 microversion: 2.20 time: 0.159962 Feb 15 04:28:57.139952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 448/866] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:56 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:57.436834 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:57.437468 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:57.443956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:57.444407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:57.445213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:57.445645 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:57.583211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:57.590563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a2789cc1-6750-4774-8df2-ff83dc3a068b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.157391 Feb 15 04:28:57.591121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 419/867] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:57 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:58.157764 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:58.158328 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:58.164443 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:58.164916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:58.165704 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:58.166109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:58.296289 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:58.304732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:58.306264 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:58.307413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a1af8c9f-7ee9-40f3-b3d8-f9eabc57bd1d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1744 microversion: 2.20 time: 0.153587 Feb 15 04:28:58.307966 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 449/868] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:58 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:28:58.607609 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:58.608223 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:58.616026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:58.616490 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:58.617304 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:58.617745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:58.754254 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:58.761486 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8ba46b11-16d3-4c7b-96f0-791ef6ceaf73 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.157602 Feb 15 04:28:58.762042 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 420/869] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:58 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:28:59.326044 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:59.326652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:59.333015 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:59.333492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:59.335015 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:59.335564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:59.469855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:59.478642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:59.479914 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:59.481101 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3262afde-3bb3-443a-97dc-5ae8c2afc617 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.158702 Feb 15 04:28:59.481656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 450/870] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:28:59 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:28:59.780996 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:28:59.782386 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:28:59.792806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:59.793379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:59.794407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:28:59.795054 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:28:59.958079 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:28:59.966707 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cc30ddb6-b01d-47b6-adb4-851cd2144aab tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.189104 Feb 15 04:28:59.967522 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 421/871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:28:59 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:00.506016 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:00.506613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:00.513370 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:00.513818 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:00.514610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:00.515333 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:00.678959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:00.688071 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:00.690514 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:00.691678 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a1134897-2704-4945-add9-32bf6a0e71a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.193308 Feb 15 04:29:00.692601 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 451/872] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:00 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:29:00.986316 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:00.987682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:00.995908 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:00.996635 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:00.997622 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:00.998216 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:01.155599 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:01.167045 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-68dd15da-36cd-4eee-881e-3741f2aa37ea tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.185228 Feb 15 04:29:01.177604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 422/873] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:00 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:01.711853 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:01.712539 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:01.725847 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:01.726819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:01.727804 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:01.728478 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:01.897434 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:01.906161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:01.907828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:01.909184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f8a9381e-33b5-491f-93f2-3e566e579bb6 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.201302 Feb 15 04:29:01.909769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 452/874] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:01 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:02.184839 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:02.185565 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:02.197665 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:02.198453 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:02.199482 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:02.199919 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:02.352805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:02.363679 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0be7b1dd-d1ab-4d1f-b505-cae166b468c9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.182228 Feb 15 04:29:02.373504 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 423/875] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:02 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:02.927573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:02.928178 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:02.936167 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:02.936613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:02.937429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:02.937856 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:03.139827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-7a4b72d8-d97c-47ac-b0a7-a7099ec02c90 req-c8175e57-73f0-4679-aa35-220bd2c8dbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c35f39-3caa-49f1-9289-7514ba7f3edb", "name": "network-vif-plugged", "status": "completed", "tag": "6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:03.142558 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:29:03.142558 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:29:03.158650 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7a4b72d8-d97c-47ac-b0a7-a7099ec02c90 req-c8175e57-73f0-4679-aa35-220bd2c8dbf1 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:03.159537 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7a4b72d8-d97c-47ac-b0a7-a7099ec02c90 req-c8175e57-73f0-4679-aa35-220bd2c8dbf1 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:03.183981 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-7a4b72d8-d97c-47ac-b0a7-a7099ec02c90 req-c8175e57-73f0-4679-aa35-220bd2c8dbf1 service nova] Creating event network-vif-plugged:6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2 for instance d1c35f39-3caa-49f1-9289-7514ba7f3edb on hv-cinder-81610 Feb 15 04:29:03.192238 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-7a4b72d8-d97c-47ac-b0a7-a7099ec02c90 req-c8175e57-73f0-4679-aa35-220bd2c8dbf1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057802 Feb 15 04:29:03.194816 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 424/876] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:29:03.323625 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:03.338422 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:03.340288 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:03.342124 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-cf8d8f79-d5b9-45e4-ad4b-e2aaea797cef tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.419004 Feb 15 04:29:03.342682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 453/877] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:02 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:03.380676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:03.381419 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:03.393032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:03.393858 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:03.395275 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:03.395885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:03.599423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:03.607478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b88dbe94-d8f8-4583-adf8-a7aa721f6393 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.231474 Feb 15 04:29:03.608484 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 425/878] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:03 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:04.364882 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:04.366706 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:04.373741 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:04.374450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:04.375245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:04.375683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:04.515143 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:04.524260 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:04.525798 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:04.526962 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-181a7e02-ba14-4045-8dfe-8b2ea68f55cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.167740 Feb 15 04:29:04.527519 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 454/879] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:04 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:04.623577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:04.624168 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:04.631144 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:04.631603 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:04.632393 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:04.632830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:04.782764 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:04.791750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8f91630b-352b-4121-88f6-1b73d1fa12dc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1265 microversion: 2.1 time: 0.171851 Feb 15 04:29:04.792717 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 426/880] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:04 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:05.548731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:05.548731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:05.555470 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:05.555920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:05.556698 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:05.557161 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:05.706393 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:05.715208 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:05.716693 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:05.718186 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-09d134d9-c3b8-4ad7-861f-6a4e6060ea62 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.176198 Feb 15 04:29:05.718811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 455/881] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:05 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:05.809952 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:05.811369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:05.819610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:05.820087 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:05.820942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:05.821386 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:05.978667 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:05.987280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-21044f6c-9bdc-4083-be49-01eef7561236 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1452 microversion: 2.1 time: 0.181093 Feb 15 04:29:05.987943 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 427/882] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:05 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:29:06.005254 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:06.006375 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:06.012874 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:06.013349 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:06.014318 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:06.014753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:06.182524 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:06.193594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b12ca5cc-c345-4ca2-a059-b54415577361 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1452 microversion: 2.1 time: 0.192219 Feb 15 04:29:06.203311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 456/883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:05 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:06.737237 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:06.738117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:06.745037 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:06.745886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:06.751786 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:06.752572 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:06.916046 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:06.925759 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:06.927611 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:06.928878 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e51cf847-95a2-4e44-a2a4-0bdea4a1e310 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.195924 Feb 15 04:29:06.941952 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 428/884] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:06 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:07.950096 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:07.951618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:07.960863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:07.961902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:07.962923 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:07.963564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:08.235964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:08.251604 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:08.254137 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:08.255737 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d75dea96-89f0-4ef6-8989-1b3e318268b5 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.310011 Feb 15 04:29:08.261634 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 457/885] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:07 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:08.405996 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-84a50c85-1be8-4549-92a6-ac534ca4076a req-f5ce814b-cab5-4f08-b341-0f5d0c2bbe50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c35f39-3caa-49f1-9289-7514ba7f3edb", "tag": "6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:08.408389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:29:08.408389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:29:08.415516 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-84a50c85-1be8-4549-92a6-ac534ca4076a req-f5ce814b-cab5-4f08-b341-0f5d0c2bbe50 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:08.415956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-84a50c85-1be8-4549-92a6-ac534ca4076a req-f5ce814b-cab5-4f08-b341-0f5d0c2bbe50 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:08.427727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-84a50c85-1be8-4549-92a6-ac534ca4076a req-f5ce814b-cab5-4f08-b341-0f5d0c2bbe50 service nova] Creating event network-changed:6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2 for instance d1c35f39-3caa-49f1-9289-7514ba7f3edb on hv-cinder-81610 Feb 15 04:29:08.433303 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-84a50c85-1be8-4549-92a6-ac534ca4076a req-f5ce814b-cab5-4f08-b341-0f5d0c2bbe50 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108969 Feb 15 04:29:08.434100 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 429/886] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:09.273847 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:09.274459 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:09.280825 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:09.281307 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:09.282078 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:09.283163 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:09.426423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:09.434750 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:09.436267 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:09.437451 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-639249c0-4369-4bdb-bc1d-3c2fdb329673 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1739 microversion: 2.20 time: 0.167401 Feb 15 04:29:09.438001 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 458/887] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:09 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:10.456365 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:10.457104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:10.463699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:10.464148 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:10.464980 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:10.465448 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:10.600833 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:10.608477 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:10.610021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:10.611208 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b60f440d-7944-401c-9de7-2e44d5f2a689 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1721 microversion: 2.20 time: 0.159353 Feb 15 04:29:10.611761 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 430/888] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:10 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:11.630008 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:11.630612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:11.636860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:11.637340 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:11.638109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:11.638543 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:11.784904 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:11.792773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:11.794297 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:11.795436 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-789ae814-bcd1-41ad-8b15-acc229d15b69 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1721 microversion: 2.20 time: 0.169875 Feb 15 04:29:11.795984 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 459/889] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:11 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:12.815312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:12.815909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:12.822376 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:12.822830 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:12.823606 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:12.824041 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:12.962070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:12.969932 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:12.971439 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:12.972608 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c1e45e70-953d-4713-a6ee-f6ddda39d860 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1664 microversion: 2.20 time: 0.161707 Feb 15 04:29:12.973434 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 431/890] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:12 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:29:12.992295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb090735-11db-4bc6-8373-c8349058bd32"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:12.993386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:12.999621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.000069 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.001487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.001935 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.053322 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-1d01bf8c-950e-446e-8afb-4792be520429 req-839aaca5-799c-43a0-b91c-3e6b66b6e249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "name": "network-vif-unplugged", "status": "completed", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:13.055524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:29:13.055524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:29:13.063340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-1d01bf8c-950e-446e-8afb-4792be520429 req-839aaca5-799c-43a0-b91c-3e6b66b6e249 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.064384 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-1d01bf8c-950e-446e-8afb-4792be520429 req-839aaca5-799c-43a0-b91c-3e6b66b6e249 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.077111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.compute.server_external_events [req-1d01bf8c-950e-446e-8afb-4792be520429 req-839aaca5-799c-43a0-b91c-3e6b66b6e249 service nova] Unable to find a host for instance 8003b584-f389-4058-8718-5e3ca7015245. Dropping event network-vif-unplugged {{(pid=116304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 15 04:29:13.078000 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-1d01bf8c-950e-446e-8afb-4792be520429 req-839aaca5-799c-43a0-b91c-3e6b66b6e249 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028543 Feb 15 04:29:13.078671 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 432/891] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 15 04:29:13.255765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-32c49c37-b8da-4c1f-88b5-fcf308927150 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.267914 Feb 15 04:29:13.256368 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 460/892] 10.222.0.45 () {62 vars in 1363 bytes} [Tue Feb 15 04:29:12 2022] POST /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-volume_attachments => generated 188 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:29:13.363597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:13.364097 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:13.370093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.370547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.371328 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.371773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.596047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-149bb8c3-0c5d-460b-9ff5-1ca1d78ebfeb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-volume_attachments/cb090735-11db-4bc6-8373-c8349058bd32" status: 202 len: 0 microversion: 2.20 time: 0.235786 Feb 15 04:29:13.596652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 433/893] 10.222.0.45 () {60 vars in 1456 bytes} [Tue Feb 15 04:29:13 2022] DELETE /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-volume_attachments/cb090735-11db-4bc6-8373-c8349058bd32 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:29:13.651324 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:13.651902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:13.658561 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.659015 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.659801 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.660233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.801466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-550db0d9-c248-43b9-9d56-f2852e3c6e0d tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "POST /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/action" status: 202 len: 0 microversion: 2.20 time: 0.153955 Feb 15 04:29:13.802186 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 461/894] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Feb 15 04:29:13 2022] POST /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:29:13.810239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:13.811015 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:13.820101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.820861 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.821745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:13.822241 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:13.960605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:13.968379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:13.970738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:13.971879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2f37e6c1-2ed6-4c2e-ac58-ddcad4f1807a tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1672 microversion: 2.20 time: 0.165462 Feb 15 04:29:13.972430 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 434/895] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:13 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:14.991440 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:14.992040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:14.998083 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:14.998534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:14.999316 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:14.999745 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:15.141232 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:15.152582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:15.154216 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:15.155374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d31b6fbe-ed08-4e4e-9cc6-3c1182392da8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.168428 Feb 15 04:29:15.155945 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 462/896] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:14 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:16.175261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:16.176801 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:16.183682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:16.184812 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:16.185899 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:16.186583 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:16.340312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:16.349615 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:16.351096 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:16.352246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-90ab159c-9cd9-42ff-8a9f-58fbe1947934 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.181667 Feb 15 04:29:16.352837 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 435/897] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:16 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:17.371160 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:17.371765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:17.378663 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:17.379079 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:17.379858 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:17.380281 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:17.520816 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:17.529803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:17.531335 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:17.533228 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5db3e92f-a677-41ed-9e65-d834716572ac tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.165751 Feb 15 04:29:17.534086 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 463/898] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:17 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:18.551472 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:18.552099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:18.559173 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:18.559625 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:18.560412 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:18.560848 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:18.706246 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:18.715266 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:18.719925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:18.719925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dc6559fd-4f35-4d3e-a3bb-41af958aa4a8 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.170550 Feb 15 04:29:18.719925 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 436/899] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:18 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:19.737154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:19.737855 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:19.745442 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:19.745929 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:19.746751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:19.747191 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:19.892029 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:19.901067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:19.902863 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:19.904170 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-68138b3d-85ea-4244-968b-8fc667cabf59 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.171940 Feb 15 04:29:19.904800 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 464/900] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:19 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:29:20.923129 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:20.923883 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:20.930396 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:20.930858 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:20.931663 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:20.932267 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:21.071936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:21.080636 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:21.082167 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:21.083338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a66bad7a-3a44-421d-8ad4-3a1340b8f351 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.164017 Feb 15 04:29:21.095164 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 437/901] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:20 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:22.105483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:22.106154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:22.113366 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:22.113816 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:22.114598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:22.115024 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:22.257272 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:22.266551 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:22.268184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:22.269435 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a70a45de-7d18-463e-8192-5bf1385920ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.170775 Feb 15 04:29:22.270006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 465/902] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:22 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:23.288967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:23.288967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:23.295643 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:23.296105 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:23.296905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:23.298001 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:23.440822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:23.448823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:23.450341 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:23.451496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5cc8adba-84b2-4ae6-9a58-633b31176c4f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.167025 Feb 15 04:29:23.453034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 438/903] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:23 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:24.470890 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:24.471622 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:24.478739 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:24.479289 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:24.480245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:24.480696 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:24.622979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:24.631877 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:24.633419 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:24.634612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e9058cae-f498-4f30-8fe8-517b21a0e8d1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.168503 Feb 15 04:29:24.635343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 466/904] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:24 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:25.653822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:25.654446 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:25.661354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:25.661808 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:25.662587 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:25.663022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:25.802614 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:25.810557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:25.812224 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:25.814032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-391d19b8-a020-4e78-9379-fd488430ad0f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.163715 Feb 15 04:29:25.814605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 439/905] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:25 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:29:26.831983 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:26.832571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:26.838889 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:26.839335 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:26.840103 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:26.840540 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:26.977527 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:26.985794 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:26.987284 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:26.988692 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e3e893db-2edd-40fd-a708-2e965b118c8b tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.160628 Feb 15 04:29:26.989295 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 467/906] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:26 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:28.007528 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:28.008110 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:28.014351 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:28.014802 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:28.015583 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:28.016020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:28.152344 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:28.160208 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:28.161708 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:28.162851 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a9ef3687-fc93-4b29-b9d7-21f762ba6c0e tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.159511 Feb 15 04:29:28.163423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 440/907] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:28 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:29.180803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:29.181446 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:29.187685 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:29.188130 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:29.188916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:29.189398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:29.319757 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:29.327492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:29.329011 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:29.330613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8933938e-9097-4abb-b452-581e76ce15e7 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.153048 Feb 15 04:29:29.331172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 468/908] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:29 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:30.020009 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:30.020575 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:30.026627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:30.027078 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:30.027849 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:30.028277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:30.057317 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e497337f-3a2a-4786-813b-6313ad8b3c18 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/c513e7c4-cfe0-41db-8d71-5b937488299c" status: 200 len: 194 microversion: 2.1 time: 0.041278 Feb 15 04:29:30.057886 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 441/909] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Feb 15 04:29:30 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/c513e7c4-cfe0-41db-8d71-5b937488299c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:30.068758 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:30.069280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:30.075098 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:30.075542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:30.076310 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:30.076742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:30.156764 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lazy-loading 'services' on Instance uuid 27e88377-792d-40c9-9e30-6e1cf6b1017c {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:29:30.226575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-61fe7506-27aa-48b1-8914-dd0246f22d37 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/c513e7c4-cfe0-41db-8d71-5b937488299c" status: 202 len: 0 microversion: 2.1 time: 0.161901 Feb 15 04:29:30.227247 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 469/910] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:29:30 2022] DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/c513e7c4-cfe0-41db-8d71-5b937488299c => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:29:30.348113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:30.348722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:30.354827 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:30.355308 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:30.356086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:30.356519 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:30.486736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:30.494918 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:30.496368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:30.497533 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea61b881-c720-40e8-89f2-75ac55b5fbc9 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.153960 Feb 15 04:29:30.498093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 442/911] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:30 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:31.516532 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:31.517175 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:31.523805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:31.524249 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:31.525041 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:31.525471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:31.661362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:31.669314 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:31.670799 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:31.671937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-904ba0ff-dc48-4269-8ac5-ac28fb61984c tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.160087 Feb 15 04:29:31.672492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 470/912] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:31 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:29:32.390392 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:32.390915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:32.397120 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:32.397591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:32.398361 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:32.398792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:32.427310 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-89da474a-047f-41e9-8e19-71ab3018144d tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/accc892c-6bcb-4559-bbaa-f3b270f3ae70" status: 200 len: 194 microversion: 2.1 time: 0.040664 Feb 15 04:29:32.427879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 443/913] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Feb 15 04:29:32 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/accc892c-6bcb-4559-bbaa-f3b270f3ae70 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:32.437785 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:32.438284 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:32.444867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:32.445353 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:32.446141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:32.446573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:32.524465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lazy-loading 'services' on Instance uuid 27e88377-792d-40c9-9e30-6e1cf6b1017c {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:29:32.591781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-56fb5894-cdad-4b66-a191-4c98d195e77e tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/accc892c-6bcb-4559-bbaa-f3b270f3ae70" status: 202 len: 0 microversion: 2.1 time: 0.157669 Feb 15 04:29:32.592379 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 471/914] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Feb 15 04:29:32 2022] DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments/accc892c-6bcb-4559-bbaa-f3b270f3ae70 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:29:32.690177 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:32.690784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:32.696717 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:32.697204 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:32.697978 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:32.698411 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:32.834006 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:32.841905 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:32.843389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:32.844524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-690cca6c-e972-4f49-9c88-bfb898dd6d7f tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.158347 Feb 15 04:29:32.845114 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 444/915] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:32 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:33.756919 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:33.757991 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:33.764536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:33.764877 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:33.765702 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:33.766141 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:33.795755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5d1ab52a-22be-4765-8893-0fe78e02774b tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042970 Feb 15 04:29:33.796313 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 472/916] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:29:33 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:29:33.863271 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:33.863910 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:33.870506 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:33.870956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:33.871743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:33.872182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:33.899018 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:33.899969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:33.905885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:33.906339 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:33.907117 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:33.907582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:33.937765 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4d3e45b9-0c51-4c16-b968-7b90f16242c2 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042425 Feb 15 04:29:33.938331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 473/917] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Feb 15 04:29:33 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 04:29:33.994082 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:33.994699 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:34.000495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:34.000969 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:34.001828 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:34.002259 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:34.012822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:34.021347 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:34.022826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:34.023971 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-55519c2c-eb3e-4f98-97cc-d5c6bc1124c0 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.165351 Feb 15 04:29:34.024523 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 445/918] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:33 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:34.027598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:29:34.102075 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-909f0019-61d8-439a-ae11-842c57ef5935 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 204 len: 0 microversion: 2.1 time: 0.111247 Feb 15 04:29:34.102823 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 474/919] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:29:33 2022] DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 04:29:34.111288 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:34.112057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:34.118096 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:34.118540 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:34.119313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:34.119738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:34.250763 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:34.258625 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5d0f0a49-b195-4e8f-9c52-2b98d35d0700 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1675 microversion: 2.1 time: 0.151133 Feb 15 04:29:34.259191 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 446/920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:34 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:35.043099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:35.043708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:35.050590 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:35.051035 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:35.051813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:35.052249 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:35.189915 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:35.198074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:35.199582 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:35.200737 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-35814c50-2f80-417b-b692-3b88ada8df40 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.161933 Feb 15 04:29:35.201338 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 475/921] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:35 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:35.224746 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-8f0c6709-5a4c-4294-b7b6-a5c3ce0892ac req-d7955d56-a45f-47f1-8d62-3a178ba4a667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "name": "network-vif-plugged", "status": "completed", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:35.226686 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:29:35.226686 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:29:35.234789 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-8f0c6709-5a4c-4294-b7b6-a5c3ce0892ac req-d7955d56-a45f-47f1-8d62-3a178ba4a667 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:35.236734 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-8f0c6709-5a4c-4294-b7b6-a5c3ce0892ac req-d7955d56-a45f-47f1-8d62-3a178ba4a667 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:35.248581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-8f0c6709-5a4c-4294-b7b6-a5c3ce0892ac req-d7955d56-a45f-47f1-8d62-3a178ba4a667 service nova] Creating event network-vif-plugged:9f6ba102-729f-4db0-85bd-4f490aab77db for instance 8003b584-f389-4058-8718-5e3ca7015245 on hv-cinder-81610 Feb 15 04:29:35.254318 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-8f0c6709-5a4c-4294-b7b6-a5c3ce0892ac req-d7955d56-a45f-47f1-8d62-3a178ba4a667 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033789 Feb 15 04:29:35.254926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 447/922] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:35.276386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:35.277023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:35.286885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:35.287333 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:35.288125 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:35.288561 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:35.430132 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:35.438145 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e9be1bb5-3682-47aa-910c-a0bc9b6ceccd tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1675 microversion: 2.1 time: 0.165384 Feb 15 04:29:35.438754 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 476/923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:35 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:29:36.219505 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:36.220198 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:36.227944 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:36.228640 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:36.229177 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:36.229682 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:36.365291 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:36.373013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:36.374491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:36.375627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d66bf885-b3ba-4e60-b802-4c9d8cff10cb tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.160231 Feb 15 04:29:36.376182 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 448/924] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:36 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:36.455465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:36.456060 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:36.462275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:36.462718 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:36.463482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:36.463910 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:36.600159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:36.607501 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fdf2e4e5-040c-4106-8d3d-9e85686fcc0c tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1675 microversion: 2.1 time: 0.155772 Feb 15 04:29:36.608076 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 477/925] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:36 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:37.396181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:37.398946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:37.403814 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:37.404508 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:37.405351 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:37.405725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:37.434032 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-cff2a5a0-1262-4e1d-8821-2997db6b3a89 req-be8ae880-b0e8-4c98-a347-738491cbb65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e88377-792d-40c9-9e30-6e1cf6b1017c", "name": "network-vif-deleted", "tag": "4f19fadb-80cd-49f6-af86-3c319fa31401"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:37.435894 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:29:37.435894 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:29:37.451371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-cff2a5a0-1262-4e1d-8821-2997db6b3a89 req-be8ae880-b0e8-4c98-a347-738491cbb65a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:37.452048 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-cff2a5a0-1262-4e1d-8821-2997db6b3a89 req-be8ae880-b0e8-4c98-a347-738491cbb65a service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:37.483206 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-cff2a5a0-1262-4e1d-8821-2997db6b3a89 req-be8ae880-b0e8-4c98-a347-738491cbb65a service nova] Creating event network-vif-deleted:4f19fadb-80cd-49f6-af86-3c319fa31401 for instance 27e88377-792d-40c9-9e30-6e1cf6b1017c on hv-cinder-81610 Feb 15 04:29:37.495556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-cff2a5a0-1262-4e1d-8821-2997db6b3a89 req-be8ae880-b0e8-4c98-a347-738491cbb65a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067509 Feb 15 04:29:37.496537 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 478/926] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:37.625433 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:37.630507 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:37.632129 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:37.637244 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:37.639168 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:37.640804 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8cda3c71-c2cf-4ded-8c2a-e58cc4e0ff41 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1730 microversion: 2.20 time: 0.250300 Feb 15 04:29:37.642023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:37.642719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 449/927] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:37 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:37.645315 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:37.646781 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:37.647531 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:37.691772 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:37.692230 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:37.692873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lazy-loading 'fault' on Instance uuid 27e88377-792d-40c9-9e30-6e1cf6b1017c {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:29:37.746433 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae6b80b4cb946208c461caebad57faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:37.767887 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bc6922df-df1a-4bd1-9eb2-acedfa57ced1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 200 len: 1328 microversion: 2.1 time: 0.138854 Feb 15 04:29:37.768736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 479/928] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:37 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 1328 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:29:38.659796 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:38.660401 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:38.666791 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:38.667233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:38.668013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:38.668465 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:38.785180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:38.785711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:38.792074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:38.792520 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:38.793331 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:38.793761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:38.807841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] HTTP exception thrown: Instance 27e88377-792d-40c9-9e30-6e1cf6b1017c could not be found. Feb 15 04:29:38.808814 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Returning 404 to user: Instance 27e88377-792d-40c9-9e30-6e1cf6b1017c could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:38.809757 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0a400486-5125-4b70-8fbe-d789850a8815 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 404 len: 111 microversion: 2.1 time: 0.028480 Feb 15 04:29:38.810414 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 480/929] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:38 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:29:38.819359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-223ab322-761c-4dd4-9628-b54920fa12b7 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '.version_select at 0x7fc5d5da0ee0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:38.837385 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-223ab322-761c-4dd4-9628-b54920fa12b7 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303299778" status: 202 len: 0 microversion: 2.1 time: 0.021451 Feb 15 04:29:38.837959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 481/930] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Feb 15 04:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303299778 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 04:29:38.865770 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:38.873885 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:38.875380 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:29:38.876610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6fea48d6-8a7b-4326-9cf7-655841dcd9cf tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1717 microversion: 2.20 time: 0.220564 Feb 15 04:29:38.877211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 450/931] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:29:38 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1717 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:29:41.971339 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:41.971881 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:41.977876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:41.978307 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:41.979085 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:41.979519 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:41.993628 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] HTTP exception thrown: Instance 27e88377-792d-40c9-9e30-6e1cf6b1017c could not be found. Feb 15 04:29:41.994209 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Returning 404 to user: Instance 27e88377-792d-40c9-9e30-6e1cf6b1017c could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:41.995017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6bab5f36-32c5-4546-8109-f07d8719afc1 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 404 len: 111 microversion: 2.1 time: 0.028520 Feb 15 04:29:41.995555 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 482/932] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:29:41 2022] DELETE /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:42.003539 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:42.004153 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: 27e88377-792d-40c9-9e30-6e1cf6b1017c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:42.010382 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:42.010832 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:42.011611 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:42.012049 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:42.025379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] HTTP exception thrown: Instance 27e88377-792d-40c9-9e30-6e1cf6b1017c could not be found. Feb 15 04:29:42.025973 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Returning 404 to user: Instance 27e88377-792d-40c9-9e30-6e1cf6b1017c could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:42.026794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d8826f48-5a93-494c-bb11-fc1ee4f4306f tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c" status: 404 len: 111 microversion: 2.1 time: 0.027197 Feb 15 04:29:42.027342 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 451/933] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:41 2022] GET /compute/v2.1/servers/27e88377-792d-40c9-9e30-6e1cf6b1017c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:43.155073 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:43.155600 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:43.162199 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:43.162753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:43.163414 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:43.163846 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:43.177686 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] HTTP exception thrown: Instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c could not be found. Feb 15 04:29:43.178261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Returning 404 to user: Instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:43.179066 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2f4898ae-f83a-47e5-944d-f35a68d47286 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 404 len: 111 microversion: 2.1 time: 0.027799 Feb 15 04:29:43.179581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 483/934] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:29:43 2022] DELETE /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:43.187261 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:43.187870 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] [instance: eda24f72-ec24-4b2a-9eed-23dbe8b9706c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:29:43.194718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:43.195171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:43.195949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:29:43.196440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:29:43.209243 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] HTTP exception thrown: Instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c could not be found. Feb 15 04:29:43.209826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] Returning 404 to user: Instance eda24f72-ec24-4b2a-9eed-23dbe8b9706c could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:43.210630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fb60409f-6b2a-4abc-b69f-64dbd51d5f58 tempest-AttachVolumeTestJSON-1670434203 tempest-AttachVolumeTestJSON-1670434203-project] 10.222.0.45 "GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c" status: 404 len: 111 microversion: 2.1 time: 0.026991 Feb 15 04:29:43.211143 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 452/935] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:29:43 2022] GET /compute/v2.1/servers/eda24f72-ec24-4b2a-9eed-23dbe8b9706c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:47.671764 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-03e17cb7-a8f6-4a44-9e5f-5e8accf1fbf3 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Action: 'create', calling method: .version_select at 0x7fc5d5d58430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1607331231"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:48.043951 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-03e17cb7-a8f6-4a44-9e5f-5e8accf1fbf3 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.480632 Feb 15 04:29:48.044656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 484/936] 10.222.0.45 () {60 vars in 1154 bytes} [Tue Feb 15 04:29:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 482 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 15 04:29:48.055987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a3018410-acd8-446a-9dfd-810940cf3334 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e26ee0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:48.108824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a3018410-acd8-446a-9dfd-810940cf3334 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 200 len: 345 microversion: 2.1 time: 0.056456 Feb 15 04:29:48.109437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 453/937] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:29:48 2022] GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:49.122429 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8690d45e-f6b8-471d-9cdc-a9905f097dfb tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5c7a4c0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:49.168109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8690d45e-f6b8-471d-9cdc-a9905f097dfb tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 200 len: 346 microversion: 2.1 time: 0.049752 Feb 15 04:29:49.168679 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 485/938] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:29:49 2022] GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:49.179904 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6173fb9f-4ce4-4fb9-86c5-25abf2c89c3d tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Action: 'create', calling method: .version_select at 0x7fc5d5ea0820>, body: {"snapshot": {"volume_id": "4efb8b46-eef1-402d-84b6-256b023e3f0e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-423896244"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:29:49.323753 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6173fb9f-4ce4-4fb9-86c5-25abf2c89c3d tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.147876 Feb 15 04:29:49.324329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 454/939] 10.222.0.45 () {60 vars in 1161 bytes} [Tue Feb 15 04:29:49 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:49.335087 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8eabbe97-4d2a-46cb-997e-cd8be59211e9 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5de8280>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:49.363867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8eabbe97-4d2a-46cb-997e-cd8be59211e9 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.032481 Feb 15 04:29:49.364415 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 486/940] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:49 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:29:49.373817 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9a8bcc53-76a7-4eb9-bf68-2234b30aba0b tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e66160>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:49.402520 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9a8bcc53-76a7-4eb9-bf68-2234b30aba0b tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032269 Feb 15 04:29:49.403078 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 455/941] 10.222.0.45 () {58 vars in 1139 bytes} [Tue Feb 15 04:29:49 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:49.412773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-fe8236a6-2068-4840-82f9-cf295cc38833 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5d4b310>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:49.440717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-fe8236a6-2068-4840-82f9-cf295cc38833 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.031481 Feb 15 04:29:49.441329 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 487/942] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:49 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:50.452656 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-88ec86d8-0f65-4280-9bb4-6a972d3b24e8 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5ea0550>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:50.482259 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-88ec86d8-0f65-4280-9bb4-6a972d3b24e8 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.033663 Feb 15 04:29:50.482842 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 456/943] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:50 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:51.494813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-688b2546-ee6e-409d-a637-efd1725e8b2b tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e57310>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:51.523573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-688b2546-ee6e-409d-a637-efd1725e8b2b tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.032893 Feb 15 04:29:51.524171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 488/944] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:51 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:52.536288 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b9ab98f8-0181-44d4-a946-60c207cf6402 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5dfb8b0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:52.565727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b9ab98f8-0181-44d4-a946-60c207cf6402 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.034066 Feb 15 04:29:52.566280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 457/945] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:52 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:53.578343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2227ae48-2eac-4eeb-b9e3-a8538291507d tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5d4b700>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:53.606457 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2227ae48-2eac-4eeb-b9e3-a8538291507d tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.032171 Feb 15 04:29:53.607028 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 489/946] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:53 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:54.618998 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8d4fd1f7-cf9f-48ec-944d-d3f1d032dfe5 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e0dee0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:54.647313 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8d4fd1f7-cf9f-48ec-944d-d3f1d032dfe5 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 287 microversion: 2.1 time: 0.032299 Feb 15 04:29:54.647871 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 458/947] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:54 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:54.658747 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4eaddea0-fcc5-49e5-ba39-13013371347d tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e76dc0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:54.714575 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4eaddea0-fcc5-49e5-ba39-13013371347d tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 202 len: 0 microversion: 2.1 time: 0.060395 Feb 15 04:29:54.715148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 490/948] 10.222.0.45 () {58 vars in 1253 bytes} [Tue Feb 15 04:29:54 2022] DELETE /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:29:54.724413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6238a052-05fd-4226-8c09-22018162e416 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5ea0a60>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:54.754457 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6238a052-05fd-4226-8c09-22018162e416 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 200 len: 286 microversion: 2.1 time: 0.034349 Feb 15 04:29:54.755056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 459/949] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:54 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:55.766428 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d4fe1336-9fc5-4337-b3ab-1b53dd6cee19 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5b40c10>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:55.790178 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-d4fe1336-9fc5-4337-b3ab-1b53dd6cee19 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] HTTP exception thrown: Snapshot 8ea5ed50-f21d-4030-a5fa-358b99689c0d could not be found. Feb 15 04:29:55.790777 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d4fe1336-9fc5-4337-b3ab-1b53dd6cee19 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Returning 404 to user: Snapshot 8ea5ed50-f21d-4030-a5fa-358b99689c0d could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:55.791632 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d4fe1336-9fc5-4337-b3ab-1b53dd6cee19 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d" status: 404 len: 111 microversion: 2.1 time: 0.029453 Feb 15 04:29:55.792164 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 491/950] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Feb 15 04:29:55 2022] GET /compute/v2.1/os-snapshots/8ea5ed50-f21d-4030-a5fa-358b99689c0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:55.801093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ae1af640-8619-42b1-a41d-79e41b85a1e8 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5f20820>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:55.859663 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ae1af640-8619-42b1-a41d-79e41b85a1e8 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 202 len: 0 microversion: 2.1 time: 0.063157 Feb 15 04:29:55.860230 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 460/951] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:29:55 2022] DELETE /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:29:55.874615 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bd4133a4-0ff3-44b6-a72a-819a41d18d7f tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e763a0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:55.920852 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bd4133a4-0ff3-44b6-a72a-819a41d18d7f tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 200 len: 345 microversion: 2.1 time: 0.054917 Feb 15 04:29:55.921487 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 492/952] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:29:55 2022] GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:29:56.934641 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3c672bfc-f8da-4c2b-96e4-05fcaedde23a tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5c5e790>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:56.962899 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-3c672bfc-f8da-4c2b-96e4-05fcaedde23a tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] HTTP exception thrown: Volume 4efb8b46-eef1-402d-84b6-256b023e3f0e could not be found. Feb 15 04:29:56.963502 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3c672bfc-f8da-4c2b-96e4-05fcaedde23a tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Returning 404 to user: Volume 4efb8b46-eef1-402d-84b6-256b023e3f0e could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:56.964369 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3c672bfc-f8da-4c2b-96e4-05fcaedde23a tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 404 len: 109 microversion: 2.1 time: 0.034003 Feb 15 04:29:56.964936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 461/953] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:29:56 2022] GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:56.975997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-af51418a-014f-4706-9d00-4a0c180e2244 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5d4be50>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:57.003873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-af51418a-014f-4706-9d00-4a0c180e2244 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] HTTP exception thrown: Volume 4efb8b46-eef1-402d-84b6-256b023e3f0e could not be found. Feb 15 04:29:57.004476 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-af51418a-014f-4706-9d00-4a0c180e2244 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Returning 404 to user: Volume 4efb8b46-eef1-402d-84b6-256b023e3f0e could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:57.005404 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-af51418a-014f-4706-9d00-4a0c180e2244 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 404 len: 109 microversion: 2.1 time: 0.033754 Feb 15 04:29:57.005959 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 493/954] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:29:56 2022] DELETE /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:57.013993 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-886ce7e0-1140-49dd-abc1-aba495841759 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Calling method '.version_select at 0x7fc5d5e0d940>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:57.042180 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-886ce7e0-1140-49dd-abc1-aba495841759 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] HTTP exception thrown: Volume 4efb8b46-eef1-402d-84b6-256b023e3f0e could not be found. Feb 15 04:29:57.042775 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-886ce7e0-1140-49dd-abc1-aba495841759 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] Returning 404 to user: Volume 4efb8b46-eef1-402d-84b6-256b023e3f0e could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:29:57.043604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-886ce7e0-1140-49dd-abc1-aba495841759 tempest-VolumesSnapshotsTestJSON-1269634071 tempest-VolumesSnapshotsTestJSON-1269634071-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e" status: 404 len: 109 microversion: 2.1 time: 0.033237 Feb 15 04:29:57.044147 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 462/955] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:29:57 2022] GET /compute/v2.1/os-volumes/4efb8b46-eef1-402d-84b6-256b023e3f0e => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:59.899103 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-990b9b79-70ad-4f6b-a67b-4141e144ce55 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5c7a940>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:29:59.944039 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-990b9b79-70ad-4f6b-a67b-4141e144ce55 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c48e97f8-b834-44c6-ac64-3c1ab66111f5" status: 200 len: 351 microversion: 2.1 time: 0.048919 Feb 15 04:29:59.944611 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 494/956] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:29:59 2022] GET /compute/v2.1/os-volumes/c48e97f8-b834-44c6-ac64-3c1ab66111f5 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:01.245355 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dcc72572-bdf9-424f-af53-9c1ed840ebb9 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5f20940>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:01.290372 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dcc72572-bdf9-424f-af53-9c1ed840ebb9 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/363ac450-5371-4572-8804-d071f12047c0" status: 200 len: 351 microversion: 2.1 time: 0.049063 Feb 15 04:30:01.290932 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 463/957] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:30:01 2022] GET /compute/v2.1/os-volumes/363ac450-5371-4572-8804-d071f12047c0 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:02.587841 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-94580e84-a25c-457b-b626-2d8ebb3184f7 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5eaa9d0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:02.633916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-94580e84-a25c-457b-b626-2d8ebb3184f7 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/923155af-061e-48d0-b215-d11e7c0269cc" status: 200 len: 351 microversion: 2.1 time: 0.050001 Feb 15 04:30:02.634573 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 495/958] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:30:02 2022] GET /compute/v2.1/os-volumes/923155af-061e-48d0-b215-d11e7c0269cc => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:02.646597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73a3d4f5-71bf-4f42-aaf4-bd3635299604 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5e0d430>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:02.726720 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73a3d4f5-71bf-4f42-aaf4-bd3635299604 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085030 Feb 15 04:30:02.727274 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 464/959] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Feb 15 04:30:02 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:30:02.738981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bdcd2ee4-b767-468d-9858-4e4fdddfa518 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5d583a0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:02.815541 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bdcd2ee4-b767-468d-9858-4e4fdddfa518 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.079728 Feb 15 04:30:02.816155 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 496/960] 10.222.0.45 () {58 vars in 1148 bytes} [Tue Feb 15 04:30:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:02.827515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c2431ed0-ebbe-4c10-8db1-0c4be9dbe3de tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5e51700>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:02.905161 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c2431ed0-ebbe-4c10-8db1-0c4be9dbe3de tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081042 Feb 15 04:30:02.905722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 465/961] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Feb 15 04:30:02 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:30:02.916592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2000f24c-70df-4f40-9f46-78e8c9cb28a9 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5da0430>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:02.994920 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2000f24c-70df-4f40-9f46-78e8c9cb28a9 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081810 Feb 15 04:30:02.995484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 497/962] 10.222.0.45 () {58 vars in 1166 bytes} [Tue Feb 15 04:30:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:03.007773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-425614fc-02bc-4024-88e2-90a91d9fd887 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5e12940>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:03.090263 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-425614fc-02bc-4024-88e2-90a91d9fd887 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086011 Feb 15 04:30:03.090829 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 466/963] 10.222.0.45 () {58 vars in 1169 bytes} [Tue Feb 15 04:30:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:03.102466 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-534fdc8c-5d35-4bc0-a3ca-2dfadfcc397b tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5e85820>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:03.181413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-534fdc8c-5d35-4bc0-a3ca-2dfadfcc397b tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082382 Feb 15 04:30:03.182242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 498/964] 10.222.0.45 () {58 vars in 1154 bytes} [Tue Feb 15 04:30:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:30:03.193605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-664d2ee8-3d5c-4499-a337-30f3cc5d27ff tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5f20d30>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:03.273712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-664d2ee8-3d5c-4499-a337-30f3cc5d27ff tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084498 Feb 15 04:30:03.274279 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 467/965] 10.222.0.45 () {58 vars in 1187 bytes} [Tue Feb 15 04:30:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:03.285676 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-9bcfae5a-12c5-4e10-99e9-d088653d2fc4 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] Calling method '.version_select at 0x7fc5d5e858b0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:03.362447 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-9bcfae5a-12c5-4e10-99e9-d088653d2fc4 tempest-VolumesTestJSON-1081630690 tempest-VolumesTestJSON-1081630690-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.079834 Feb 15 04:30:03.363540 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 499/966] 10.222.0.45 () {58 vars in 1154 bytes} [Tue Feb 15 04:30:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:30:48.188802 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:48.189900 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:48.197637 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:48.198186 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:48.199003 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:48.199439 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:48.229236 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-980a9a96-7d91-449d-aab6-8795b9c1b864 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045176 Feb 15 04:30:48.229897 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 468/967] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Feb 15 04:30:48 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:30:48.294144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:48.294808 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:48.301364 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:48.301895 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:48.302699 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:48.303642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:48.327895 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:30:48.406275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-cb39d043-9ada-4b33-9aec-2270beb21042 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 204 len: 0 microversion: 2.20 time: 0.116114 Feb 15 04:30:48.407258 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 500/968] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Feb 15 04:30:48 2022] DELETE /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 04:30:48.416484 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:48.417222 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:48.423368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:48.423822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:48.424606 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:48.425119 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:48.558457 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:48.566086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:48.568228 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:48.569404 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b55c4410-6c88-4c52-9e51-3d8278e4c965 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.156779 Feb 15 04:30:48.569954 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 469/969] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:30:48 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 04:30:49.588152 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:49.588958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:49.596370 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:49.596838 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:49.598239 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:49.598681 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:49.743752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:49.752534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:49.754061 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:49.755255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1ea97325-4c27-4e37-af0e-f42b90cc3d82 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1723 microversion: 2.20 time: 0.171360 Feb 15 04:30:49.755829 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 501/970] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:30:49 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:30:50.773300 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:50.773890 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:50.780534 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:50.781016 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:50.782014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:50.782453 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:50.894158 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:50.904340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:50.908947 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '246b8f1d109749f3a8cf3da973aacaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6908f5f033f4c8888210c0cf405f4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:30:50.910128 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-89820738-8735-48ab-a78a-778148a142a1 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 200 len: 1655 microversion: 2.20 time: 0.140739 Feb 15 04:30:50.921312 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 470/971] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:30:50 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 04:30:51.081943 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-76784b3b-c694-40f2-ac48-3a5014e29ad6 req-fb720f21-6c01-4c9c-9f20-5b991cd03fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003b584-f389-4058-8718-5e3ca7015245", "name": "network-vif-deleted", "tag": "9f6ba102-729f-4db0-85bd-4f490aab77db"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:30:51.088639 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:30:51.088639 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:30:51.101205 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-76784b3b-c694-40f2-ac48-3a5014e29ad6 req-fb720f21-6c01-4c9c-9f20-5b991cd03fd4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:51.101902 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-76784b3b-c694-40f2-ac48-3a5014e29ad6 req-fb720f21-6c01-4c9c-9f20-5b991cd03fd4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:51.119422 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-76784b3b-c694-40f2-ac48-3a5014e29ad6 req-fb720f21-6c01-4c9c-9f20-5b991cd03fd4 service nova] Creating event network-vif-deleted:9f6ba102-729f-4db0-85bd-4f490aab77db for instance 8003b584-f389-4058-8718-5e3ca7015245 on hv-cinder-81610 Feb 15 04:30:51.125833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-76784b3b-c694-40f2-ac48-3a5014e29ad6 req-fb720f21-6c01-4c9c-9f20-5b991cd03fd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231808 Feb 15 04:30:51.130425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 502/972] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:30:51.932867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:51.933447 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:51.942760 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:51.943264 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:51.944202 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:51.944634 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:51.959873 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] HTTP exception thrown: Instance 8003b584-f389-4058-8718-5e3ca7015245 could not be found. Feb 15 04:30:51.960507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Returning 404 to user: Instance 8003b584-f389-4058-8718-5e3ca7015245 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:51.961410 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7f14a3a6-b853-4daf-b13d-0b6997792091 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 404 len: 111 microversion: 2.20 time: 0.033737 Feb 15 04:30:51.962785 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 471/973] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:30:51 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 04:30:51.972670 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4c2e614f-8dc1-46e2-9153-82080f0747af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '.version_select at 0x7fc5d5eaab80>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:51.994455 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4c2e614f-8dc1-46e2-9153-82080f0747af tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754600533" status: 204 len: 0 microversion: 2.20 time: 0.026961 Feb 15 04:30:51.995754 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 503/974] 10.222.0.45 () {60 vars in 1258 bytes} [Tue Feb 15 04:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754600533 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 04:30:53.797932 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:53.798455 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:53.808676 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:53.809096 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:53.812657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:53.812657 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:53.826359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] HTTP exception thrown: Instance 8003b584-f389-4058-8718-5e3ca7015245 could not be found. Feb 15 04:30:53.826979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Returning 404 to user: Instance 8003b584-f389-4058-8718-5e3ca7015245 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:53.827815 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c62142b0-b158-4d29-ae98-8fb26e3b5945 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 404 len: 111 microversion: 2.20 time: 0.033664 Feb 15 04:30:53.828362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 472/975] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Feb 15 04:30:53 2022] DELETE /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:53.837213 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:53.838505 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 8003b584-f389-4058-8718-5e3ca7015245] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:53.847120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:53.847580 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:53.848370 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:53.848806 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:53.862003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] HTTP exception thrown: Instance 8003b584-f389-4058-8718-5e3ca7015245 could not be found. Feb 15 04:30:53.863131 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Returning 404 to user: Instance 8003b584-f389-4058-8718-5e3ca7015245 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:53.863682 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e1e4945c-1570-458c-bcfc-6ae4c42990ca tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245" status: 404 len: 111 microversion: 2.20 time: 0.031152 Feb 15 04:30:53.864235 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 504/976] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:30:53 2022] GET /compute/v2.1/servers/8003b584-f389-4058-8718-5e3ca7015245 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:54.997352 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:54.997909 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:55.009505 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:55.010699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:55.011510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:55.011950 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:55.027227 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] HTTP exception thrown: Instance 6bfde5a4-3494-4123-b1d1-aa408427983a could not be found. Feb 15 04:30:55.027926 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Returning 404 to user: Instance 6bfde5a4-3494-4123-b1d1-aa408427983a could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:55.028833 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-637fd6b6-f608-41f3-8ab5-33bebb0c2f32 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 404 len: 111 microversion: 2.20 time: 0.035376 Feb 15 04:30:55.029490 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 473/977] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Feb 15 04:30:54 2022] DELETE /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:55.037538 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:55.038139 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] [instance: 6bfde5a4-3494-4123-b1d1-aa408427983a] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:30:55.045067 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:55.045672 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:55.046773 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:30:55.047212 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:30:55.060717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] HTTP exception thrown: Instance 6bfde5a4-3494-4123-b1d1-aa408427983a could not be found. Feb 15 04:30:55.061362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] Returning 404 to user: Instance 6bfde5a4-3494-4123-b1d1-aa408427983a could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:55.062173 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-294233f5-5bb3-4a80-8b6f-0706e67a7666 tempest-AttachVolumeShelveTestJSON-868930975 tempest-AttachVolumeShelveTestJSON-868930975-project] 10.222.0.45 "GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a" status: 404 len: 111 microversion: 2.20 time: 0.028463 Feb 15 04:30:55.062710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 505/978] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Feb 15 04:30:55 2022] GET /compute/v2.1/servers/6bfde5a4-3494-4123-b1d1-aa408427983a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:59.849598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f8ebdc88-c97c-49ee-b572-875a749035a7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Action: 'create', calling method: .version_select at 0x7fc5d5e0dd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-885768287", "metadata": {"Type": "work"}}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:30:59.851028 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f8ebdc88-c97c-49ee-b572-875a749035a7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:59.851862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f8ebdc88-c97c-49ee-b572-875a749035a7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.116509 Feb 15 04:30:59.852385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 474/979] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Feb 15 04:30:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:59.861471 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2c3e261c-e26d-4d33-83f2-d461afbfc98b tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Action: 'create', calling method: .version_select at 0x7fc5d5b5c1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1386305755", "metadata": {"Type": "work"}}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:30:59.863127 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2c3e261c-e26d-4d33-83f2-d461afbfc98b tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:59.863916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2c3e261c-e26d-4d33-83f2-d461afbfc98b tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006193 Feb 15 04:30:59.864425 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 506/980] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Feb 15 04:30:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:59.874334 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5df475a0-34be-43f6-a1bf-a4114029f552 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Action: 'create', calling method: .version_select at 0x7fc5d6028dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-59072605", "metadata": {"Type": "work"}}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:30:59.876379 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5df475a0-34be-43f6-a1bf-a4114029f552 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:59.877698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5df475a0-34be-43f6-a1bf-a4114029f552 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008704 Feb 15 04:30:59.879066 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 475/981] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Feb 15 04:30:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 04:30:59.888813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-25d494c0-971a-4aab-9752-2ca6bba35a97 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Calling method '.version_select at 0x7fc5d5d588b0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:59.916279 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-25d494c0-971a-4aab-9752-2ca6bba35a97 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] HTTP exception thrown: Volume tempest-invalid-370754858 could not be found. Feb 15 04:30:59.916861 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-25d494c0-971a-4aab-9752-2ca6bba35a97 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Returning 404 to user: Volume tempest-invalid-370754858 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:59.917697 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-25d494c0-971a-4aab-9752-2ca6bba35a97 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-370754858" status: 404 len: 98 microversion: 2.1 time: 0.033751 Feb 15 04:30:59.918234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 507/982] 10.222.0.45 () {58 vars in 1214 bytes} [Tue Feb 15 04:30:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-370754858 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 15 04:30:59.927267 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-26e3031f-11e0-4964-a8ea-0b115d32b6ae tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003641 Feb 15 04:30:59.927612 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 476/983] 10.222.0.45 () {58 vars in 1139 bytes} [Tue Feb 15 04:30:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 15 04:30:59.936489 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3d053dd8-bc61-4491-862c-be970c2173da tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003596 Feb 15 04:30:59.937009 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 508/984] 10.222.0.45 () {58 vars in 1136 bytes} [Tue Feb 15 04:30:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 15 04:30:59.945296 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fc1fb2a7-8473-4c1d-86c7-bdfe1f05c4ef tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Calling method '.version_select at 0x7fc5d5e0d670>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:30:59.971374 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-fc1fb2a7-8473-4c1d-86c7-bdfe1f05c4ef tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] HTTP exception thrown: Volume b2ef5a52-1d0d-4a35-b580-17955fab1724 could not be found. Feb 15 04:30:59.971969 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fc1fb2a7-8473-4c1d-86c7-bdfe1f05c4ef tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Returning 404 to user: Volume b2ef5a52-1d0d-4a35-b580-17955fab1724 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:30:59.972790 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fc1fb2a7-8473-4c1d-86c7-bdfe1f05c4ef tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/b2ef5a52-1d0d-4a35-b580-17955fab1724" status: 404 len: 109 microversion: 2.1 time: 0.031035 Feb 15 04:30:59.973391 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 477/985] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:30:59 2022] DELETE /compute/v2.1/os-volumes/b2ef5a52-1d0d-4a35-b580-17955fab1724 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:30:59.982691 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-08b6f81a-8fbe-49f3-a845-a336b8a923c7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Calling method '.version_select at 0x7fc5d5e76280>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:00.008710 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-08b6f81a-8fbe-49f3-a845-a336b8a923c7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] HTTP exception thrown: Volume 8fdd5108-59b0-47df-891a-90a17acef145 could not be found. Feb 15 04:31:00.009401 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-08b6f81a-8fbe-49f3-a845-a336b8a923c7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] Returning 404 to user: Volume 8fdd5108-59b0-47df-891a-90a17acef145 could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:31:00.010214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-08b6f81a-8fbe-49f3-a845-a336b8a923c7 tempest-VolumesNegativeTest-1361436239 tempest-VolumesNegativeTest-1361436239-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8fdd5108-59b0-47df-891a-90a17acef145" status: 404 len: 109 microversion: 2.1 time: 0.031136 Feb 15 04:31:00.010758 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 509/986] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Feb 15 04:30:59 2022] GET /compute/v2.1/os-volumes/8fdd5108-59b0-47df-891a-90a17acef145 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:31:22.903848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:31:22.904526 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:31:38.120067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:38.120624 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:38.127619 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:38.128067 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:38.128837 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:38.129294 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:38.152862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:31:38.212341 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:31:38.212630 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb (ip 10.222.0.45) !!! Feb 15 04:31:38.230831 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-05d2c1f0-c323-45f3-a55d-8ba687c596ec tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 204 len: 0 microversion: 2.1 time: 0.114537 Feb 15 04:31:38.231338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 478/987] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:31:38 2022] DELETE /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:31:38.242063 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:38.242680 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:38.249348 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:38.249805 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:38.250593 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:38.251033 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:38.390132 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:38.397413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-accf3001-436d-40c6-8c28-51da8a7142bb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.160829 Feb 15 04:31:38.397965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 510/988] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:38 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:39.415093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:39.415697 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:39.422697 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:39.423140 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:39.423903 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:39.424334 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:39.561366 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:39.568936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-60f55cb0-c043-486e-87e2-edb1919bfba2 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.157919 Feb 15 04:31:39.569504 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 479/989] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:39 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:40.586370 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:40.586978 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:40.593956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:40.594405 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:40.595184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:40.595616 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:40.738341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:40.745717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2941bac5-7299-418e-9515-ba5f84072600 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.162995 Feb 15 04:31:40.746287 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 511/990] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:40 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:41.763571 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:41.764186 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:41.770520 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:41.770967 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:41.771777 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:41.772215 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:41.917075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:41.924418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-49b0de3d-9193-42b0-8d65-f7c299eedeb7 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.164955 Feb 15 04:31:41.925026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 480/991] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:41 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:42.941739 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:42.942266 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:42.948693 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:42.949180 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:42.949964 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:42.950398 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:43.090184 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:43.098162 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-46b6466e-047c-4883-a6d4-268f5375e759 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.160199 Feb 15 04:31:43.098723 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 512/992] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:42 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:44.115903 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:44.116437 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:44.123364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:44.123823 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:44.124605 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:44.125083 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:44.258741 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:44.267285 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-703df7f5-5869-4509-a566-50b998bfb26f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.155385 Feb 15 04:31:44.267837 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 481/993] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:44 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:45.283642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:45.284292 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:45.290663 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:45.291120 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:45.292042 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:45.292477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:45.431288 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:45.438729 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-050c6b12-f87b-4662-983a-749faa716e11 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.158689 Feb 15 04:31:45.439274 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 513/994] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:45 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:46.455123 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:46.455736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:46.465568 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:46.466013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:46.467306 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:46.467802 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:46.600289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:46.608108 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a58be19f-950e-47a5-a9d4-150e0ea18582 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.156661 Feb 15 04:31:46.608666 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 482/995] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:46 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:47.625114 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:47.625731 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:47.631997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:47.632476 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:47.633281 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:47.633717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:47.771905 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:47.779783 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1ea7b0bd-0917-4522-a130-90c2f2fcd9ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.158666 Feb 15 04:31:47.780342 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 514/996] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:47 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:48.701329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-4d9c84b8-ee4b-4042-81c2-8e42c6b46aab req-d760e70a-bab9-4408-b876-41f3c4cf591f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c35f39-3caa-49f1-9289-7514ba7f3edb", "name": "network-vif-unplugged", "status": "completed", "tag": "6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:31:48.702992 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:31:48.702992 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:31:48.709912 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-4d9c84b8-ee4b-4042-81c2-8e42c6b46aab req-d760e70a-bab9-4408-b876-41f3c4cf591f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:48.710280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-4d9c84b8-ee4b-4042-81c2-8e42c6b46aab req-d760e70a-bab9-4408-b876-41f3c4cf591f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:48.722336 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-4d9c84b8-ee4b-4042-81c2-8e42c6b46aab req-d760e70a-bab9-4408-b876-41f3c4cf591f service nova] Creating event network-vif-unplugged:6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2 for instance d1c35f39-3caa-49f1-9289-7514ba7f3edb on hv-cinder-81610 Feb 15 04:31:48.727366 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-4d9c84b8-ee4b-4042-81c2-8e42c6b46aab req-d760e70a-bab9-4408-b876-41f3c4cf591f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159846 Feb 15 04:31:48.727949 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 483/997] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:31:48.797256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:48.797865 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:48.804151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:48.804597 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:48.805396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:48.805832 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:48.945761 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:48.953351 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-23549946-aec6-4e74-a26a-796ba35f3edc tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 200 len: 1577 microversion: 2.1 time: 0.160601 Feb 15 04:31:48.953895 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 515/998] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:48 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:49.267428 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-9c1918e4-6eed-4a78-a3a9-a1fa3b1ff6b4 req-fed37ff4-73cb-4405-b863-c3baa819f431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c35f39-3caa-49f1-9289-7514ba7f3edb", "name": "network-vif-deleted", "tag": "6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:31:49.268982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:31:49.268982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:31:49.277032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9c1918e4-6eed-4a78-a3a9-a1fa3b1ff6b4 req-fed37ff4-73cb-4405-b863-c3baa819f431 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:49.277470 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9c1918e4-6eed-4a78-a3a9-a1fa3b1ff6b4 req-fed37ff4-73cb-4405-b863-c3baa819f431 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:49.290574 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-9c1918e4-6eed-4a78-a3a9-a1fa3b1ff6b4 req-fed37ff4-73cb-4405-b863-c3baa819f431 service nova] Creating event network-vif-deleted:6b5c6d57-8dc7-4d37-8b4c-e82fe481aca2 for instance d1c35f39-3caa-49f1-9289-7514ba7f3edb on hv-cinder-81610 Feb 15 04:31:49.296850 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-9c1918e4-6eed-4a78-a3a9-a1fa3b1ff6b4 req-fed37ff4-73cb-4405-b863-c3baa819f431 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Feb 15 04:31:49.297600 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 484/999] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:31:49.971548 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:49.972150 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:49.979095 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:49.979780 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:49.980737 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:49.981346 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:49.996222 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] HTTP exception thrown: Instance d1c35f39-3caa-49f1-9289-7514ba7f3edb could not be found. Feb 15 04:31:49.996815 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Returning 404 to user: Instance d1c35f39-3caa-49f1-9289-7514ba7f3edb could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:31:49.997901 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e0ef6a5a-83f8-4cde-a3fc-9d0dd5973b82 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 404 len: 111 microversion: 2.1 time: 0.030051 Feb 15 04:31:49.998656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 516/1000] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:49 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:31:50.102155 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1592499322", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-557449170", "security_groups": [{"name": "tempest-secgroup-smoke-1039074646"}], "block_device_mapping_v2": [{"uuid": "df645ad8-464d-45ed-bf60-3cd5614edbd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4287db8-7eb1-4b55-9815-94bfd52e6a07"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:31:50.220838 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] validate_networks() for [('a4287db8-7eb1-4b55-9815-94bfd52e6a07', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:31:50.698843 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:31:50.699275 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:31:50.699759 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:31:50.700169 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:31:50.701277 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:31:50.710360 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:50.710813 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:50.711627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:50.712070 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:50.728936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:31:50.733117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for user 38c585ad31ef4f50bd695bb379107a9a and project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:31:50.788178 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:31:50.790465 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df645ad8-464d-45ed-bf60-3cd5614edbd9',volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:31:50.909292 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6bdd8eba-d5c4-46d9-a495-0bb0a5f61a15 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811619 Feb 15 04:31:50.909923 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 485/1001] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:31:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 04:31:50.920273 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-dff476c3-af90-4aec-9e5e-aaa6b2f2d15d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:50.921023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-dff476c3-af90-4aec-9e5e-aaa6b2f2d15d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:50.973913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-dff476c3-af90-4aec-9e5e-aaa6b2f2d15d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:50.981061 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-dff476c3-af90-4aec-9e5e-aaa6b2f2d15d tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1094 microversion: 2.1 time: 0.064914 Feb 15 04:31:50.981626 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 517/1002] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:50 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:52.000453 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:52.001060 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:52.008181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:52.008632 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:52.009430 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:52.009862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:52.071797 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:52.080307 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-41ff9b4d-01b6-418e-92a9-bec62aa181ef tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1144 microversion: 2.1 time: 0.085171 Feb 15 04:31:52.081104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 486/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:51 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:53.097407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:53.097965 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:53.104949 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:53.105400 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:53.106173 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:53.106607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:53.169989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:53.177673 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2b9576d8-27cb-4625-8090-4c54bb094c80 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1136 microversion: 2.1 time: 0.083979 Feb 15 04:31:53.178243 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 518/1004] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:53 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:54.196319 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:54.197051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:54.204200 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:54.204653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:54.205493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:54.205931 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:54.290936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:54.299424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ac8a3682-f251-41c2-a8b0-d986ebc21b56 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1200 microversion: 2.1 time: 0.107762 Feb 15 04:31:54.300524 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 487/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:54 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1200 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:55.316094 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:55.316844 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:55.323661 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:55.324116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:55.324952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:55.325374 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:55.465534 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:55.474036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0394d4af-2b79-486d-8ccb-c7e2bbb4ec4a tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1278 microversion: 2.1 time: 0.161721 Feb 15 04:31:55.474597 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 519/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:55 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:56.491431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:56.492053 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:56.499250 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:56.499706 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:56.500500 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:56.500955 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:56.755712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:56.763493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6d066e77-3070-426b-b2e6-123d58721b5b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1278 microversion: 2.1 time: 0.275579 Feb 15 04:31:56.764081 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 488/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:56 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:31:56.897343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-094dc4d1-dcf0-4f09-a8d6-c360360d87df req-de1e0688-feeb-448a-b742-12b51bf81e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884ded66-8e3c-413d-b360-0f2024256a72", "tag": "ad381897-0664-4940-8ca2-2fcfdaa2250f"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:31:56.899003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:31:56.899003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:31:56.907378 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-094dc4d1-dcf0-4f09-a8d6-c360360d87df req-de1e0688-feeb-448a-b742-12b51bf81e03 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:56.907822 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-094dc4d1-dcf0-4f09-a8d6-c360360d87df req-de1e0688-feeb-448a-b742-12b51bf81e03 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:56.923472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-094dc4d1-dcf0-4f09-a8d6-c360360d87df req-de1e0688-feeb-448a-b742-12b51bf81e03 service nova] Creating event network-changed:ad381897-0664-4940-8ca2-2fcfdaa2250f for instance 884ded66-8e3c-413d-b360-0f2024256a72 on hv-cinder-81610 Feb 15 04:31:56.928944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-094dc4d1-dcf0-4f09-a8d6-c360360d87df req-de1e0688-feeb-448a-b742-12b51bf81e03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036490 Feb 15 04:31:56.929556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 520/1008] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:31:57.779952 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:57.780561 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:57.787097 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:57.787563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:57.788346 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:57.788773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:57.932912 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:57.940364 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-926b4730-ad7f-4345-9579-0c167943bbb1 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1278 microversion: 2.1 time: 0.164651 Feb 15 04:31:57.940942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 489/1009] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:57 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:31:58.957909 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:31:58.958603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:31:58.965135 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:58.965589 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:58.966441 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:31:58.966878 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:31:59.106040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:31:59.114835 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-acb0b329-3492-4340-877e-8c29ec3669e5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1278 microversion: 2.1 time: 0.160760 Feb 15 04:31:59.115548 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 521/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:31:58 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:00.131510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:00.132056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:00.138766 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:00.138973 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:00.139649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:00.140197 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:00.283489 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:00.290942 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b61c21b4-8250-4fa6-a915-5cc2d342349f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.163204 Feb 15 04:32:00.291512 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 490/1011] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:00 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:01.308361 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:01.308940 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:01.315108 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:01.315555 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:01.316336 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:01.316769 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:01.453721 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:01.460977 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f004f2d7-cb2d-4828-a499-1e2c6eed37af tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.156374 Feb 15 04:32:01.461550 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 522/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:01 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:02.477688 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:02.478281 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:02.485610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:02.486149 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:02.487185 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:02.487620 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:02.627668 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:02.635425 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-56d5b0d3-74a8-4785-8767-ff53f0742a3b tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.161351 Feb 15 04:32:02.635999 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 491/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:02 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:03.651598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:03.652214 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:03.658178 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:03.658621 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:03.659449 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:03.660014 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:03.812729 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:03.820609 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-7eaf0cf6-57ba-4729-8114-af8d76f9e5f8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.172831 Feb 15 04:32:03.821126 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 523/1014] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:03 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:04.837716 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:04.839145 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:04.846296 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:04.846988 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:04.847800 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:04.848235 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:05.011057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:05.021030 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-55fb35ab-8881-4ac6-9db1-93ebe54f2c24 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.186797 Feb 15 04:32:05.022133 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 492/1015] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:04 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:06.038348 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:06.039746 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:06.045584 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:06.045980 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:06.047450 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:06.047885 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:06.188652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:06.196210 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-31418063-18ac-4ba9-8ac8-64ba2c301843 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.161552 Feb 15 04:32:06.196833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 524/1016] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:06 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:07.212362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:07.212970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:07.219719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:07.220160 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:07.220956 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:07.221385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:07.354161 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:07.361638 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dbbc3b4f-070f-452f-935f-79c4335599f6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.152933 Feb 15 04:32:07.362475 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 493/1017] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:07 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:08.380022 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:08.380646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:08.387283 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:08.387848 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:08.388732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:08.389201 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:08.529918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:08.538311 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0b82f3d4-abd0-400d-bcbf-b43021e425fb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.162466 Feb 15 04:32:08.538887 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 525/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:08 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:09.555338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:09.555976 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:09.562321 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:09.562813 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:09.563593 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:09.564026 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:09.699117 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:09.707004 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e3f5b6b6-814e-4d2d-b83d-a4d269229454 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.155366 Feb 15 04:32:09.707569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 494/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:09 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:10.716791 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-a4105e69-adb0-4f78-98f0-63dc0680ada1 req-3499a287-128e-45e1-8d70-7eb92ad4bf3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884ded66-8e3c-413d-b360-0f2024256a72", "name": "network-vif-plugged", "status": "completed", "tag": "ad381897-0664-4940-8ca2-2fcfdaa2250f"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:32:10.725012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:10.725730 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:10.729416 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:32:10.729416 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:32:10.739731 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:10.740188 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:10.741020 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:10.741490 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:10.746280 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-a4105e69-adb0-4f78-98f0-63dc0680ada1 req-3499a287-128e-45e1-8d70-7eb92ad4bf3f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:10.750536 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-a4105e69-adb0-4f78-98f0-63dc0680ada1 req-3499a287-128e-45e1-8d70-7eb92ad4bf3f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:10.776407 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-a4105e69-adb0-4f78-98f0-63dc0680ada1 req-3499a287-128e-45e1-8d70-7eb92ad4bf3f service nova] Creating event network-vif-plugged:ad381897-0664-4940-8ca2-2fcfdaa2250f for instance 884ded66-8e3c-413d-b360-0f2024256a72 on hv-cinder-81610 Feb 15 04:32:10.782327 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-a4105e69-adb0-4f78-98f0-63dc0680ada1 req-3499a287-128e-45e1-8d70-7eb92ad4bf3f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069067 Feb 15 04:32:10.783391 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 526/1020] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:32:10.929021 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:10.942167 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0ed60b14-1bda-4f5f-993e-514014ee647c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.221559 Feb 15 04:32:10.942770 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 495/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:10 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:11.960154 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:11.960840 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:11.966826 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:11.967594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:11.968045 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:11.969188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:12.113465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:12.120566 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d5d6de14-6afb-4098-900d-ad92ee57b218 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1266 microversion: 2.1 time: 0.164873 Feb 15 04:32:12.121365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 527/1022] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:11 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:13.137007 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:13.137724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:13.144305 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:13.144750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:13.145554 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:13.145986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:13.285318 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:13.293397 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-68c01d36-cd82-42d1-99cc-16aff0cda42f tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1454 microversion: 2.1 time: 0.159977 Feb 15 04:32:13.294050 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 496/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:13 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:13.309956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:13.310562 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:13.316954 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:13.317412 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:13.318188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:13.318623 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:13.454253 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:13.461899 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-255f5428-7333-4a3f-a358-ad859ea0b0cd tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1454 microversion: 2.1 time: 0.155706 Feb 15 04:32:13.462586 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 528/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:13 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:15.102144 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-a0bdc30b-1320-4867-8687-d5b0bbffdf7b req-80292f9a-7b67-445a-8a53-1cf0ca5e1b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884ded66-8e3c-413d-b360-0f2024256a72", "tag": "ad381897-0664-4940-8ca2-2fcfdaa2250f"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:32:15.103773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:32:15.103773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:32:15.117862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a0bdc30b-1320-4867-8687-d5b0bbffdf7b req-80292f9a-7b67-445a-8a53-1cf0ca5e1b9d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:15.118521 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a0bdc30b-1320-4867-8687-d5b0bbffdf7b req-80292f9a-7b67-445a-8a53-1cf0ca5e1b9d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:15.130229 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-a0bdc30b-1320-4867-8687-d5b0bbffdf7b req-80292f9a-7b67-445a-8a53-1cf0ca5e1b9d service nova] Creating event network-changed:ad381897-0664-4940-8ca2-2fcfdaa2250f for instance 884ded66-8e3c-413d-b360-0f2024256a72 on hv-cinder-81610 Feb 15 04:32:15.136033 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-a0bdc30b-1320-4867-8687-d5b0bbffdf7b req-80292f9a-7b67-445a-8a53-1cf0ca5e1b9d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037403 Feb 15 04:32:15.137047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 497/1025] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:32:28.298448 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8b7a69d8-8f12-4965-96a5-bce32d3bba9c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Action: 'create', calling method: .version_select at 0x7fc5d5e76790>, body: {"keypair": {"name": "tempest-TestShelveInstance-11064184"}} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:32:28.312708 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-8b7a69d8-8f12-4965-96a5-bce32d3bba9c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Getting quotas for project d151428e70f24ac99f8799103edf54fc. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:32:28.316763 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-8b7a69d8-8f12-4965-96a5-bce32d3bba9c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Getting quotas for user 49e57f179296489a9cd4c8d2b028a152 and project d151428e70f24ac99f8799103edf54fc. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:32:28.609376 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-8b7a69d8-8f12-4965-96a5-bce32d3bba9c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Getting quotas for project d151428e70f24ac99f8799103edf54fc. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:32:28.614952 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.quota [None req-8b7a69d8-8f12-4965-96a5-bce32d3bba9c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Getting quotas for user 49e57f179296489a9cd4c8d2b028a152 and project d151428e70f24ac99f8799103edf54fc. Resources: {'key_pairs'} {{(pid=116305) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:32:28.630803 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8b7a69d8-8f12-4965-96a5-bce32d3bba9c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2310 microversion: 2.1 time: 0.521606 Feb 15 04:32:28.631413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 529/1026] 10.222.0.45 () {60 vars in 1157 bytes} [Tue Feb 15 04:32:28 2022] POST /compute/v2.1/os-keypairs => generated 2310 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:50.990718 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-865494446", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-11064184", "security_groups": [{"name": "tempest-secgroup-smoke-647221003"}], "networks": [{"uuid": "b1563904-5b49-4443-8b4e-de885b6b8524"}], "block_device_mapping_v2": [{"uuid": "b4f70ea0-5404-456c-bab0-23b3a77d97f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:32:51.098712 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] validate_networks() for [('b1563904-5b49-4443-8b4e-de885b6b8524', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:32:51.746709 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:32:51.747375 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:32:51.747854 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:32:51.748751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:32:51.749233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:32:51.759725 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:51.760234 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:51.760836 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:51.761314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:51.778101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Getting quotas for project d151428e70f24ac99f8799103edf54fc. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:32:51.781897 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Getting quotas for user 49e57f179296489a9cd4c8d2b028a152 and project d151428e70f24ac99f8799103edf54fc. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:32:51.839621 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:32:51.841860 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4f70ea0-5404-456c-bab0-23b3a77d97f4',volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:32:51.962140 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dfb4f91b-0086-4324-b69f-dd0904e64b46 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.976408 Feb 15 04:32:51.962780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 498/1027] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:32:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:32:51.972296 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e1b2f00f-3484-4498-a157-353b6ff44a56 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:51.972923 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e1b2f00f-3484-4498-a157-353b6ff44a56 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:52.026601 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e1b2f00f-3484-4498-a157-353b6ff44a56 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:52.035916 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e1b2f00f-3484-4498-a157-353b6ff44a56 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1086 microversion: 2.1 time: 0.066507 Feb 15 04:32:52.036824 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 530/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:51 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1086 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:53.053104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:53.053721 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:53.060405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:53.060860 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:53.061670 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:53.062297 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:53.134338 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:53.141902 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9481f95b-5fde-4cf7-bedf-45d3c95acd7e tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1202 microversion: 2.1 time: 0.093092 Feb 15 04:32:53.143306 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 499/1029] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:53 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:54.160246 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:54.160850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:54.167612 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:54.168070 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:54.168864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:54.169343 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:54.244663 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-7e78891c-dd5c-48a4-9ba0-e33933f9b770 req-80769426-a93b-46e4-96b0-c9b4bdc4e776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:32:54.246982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:32:54.246982 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:32:54.256124 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7e78891c-dd5c-48a4-9ba0-e33933f9b770 req-80769426-a93b-46e4-96b0-c9b4bdc4e776 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:54.256569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7e78891c-dd5c-48a4-9ba0-e33933f9b770 req-80769426-a93b-46e4-96b0-c9b4bdc4e776 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:54.284389 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-7e78891c-dd5c-48a4-9ba0-e33933f9b770 req-80769426-a93b-46e4-96b0-c9b4bdc4e776 service nova] Creating event network-changed:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:32:54.295581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-7e78891c-dd5c-48a4-9ba0-e33933f9b770 req-80769426-a93b-46e4-96b0-c9b4bdc4e776 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054332 Feb 15 04:32:54.296211 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 500/1030] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:32:54.319538 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:54.327904 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-832835c2-b425-461f-89a1-ecb3807a8ad9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.172152 Feb 15 04:32:54.331998 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 531/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:54 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:55.347086 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:55.347771 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:55.353904 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:55.354404 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:55.355224 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:55.355597 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:55.491444 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:55.498950 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5e874471-f344-4bce-801a-f4bd42a70b38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.156776 Feb 15 04:32:55.499515 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 501/1032] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:55 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:56.516250 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:56.516873 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:56.523953 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:56.524401 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:56.525206 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:56.525641 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:56.662371 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:56.669622 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c61c8105-fedc-4e2c-ace6-1b4c309e8c87 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.157006 Feb 15 04:32:56.670195 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 532/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:56 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:57.686436 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:57.687052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:57.693415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:57.693867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:57.694644 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:57.695087 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:57.840231 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:57.848404 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cba9d6ad-b3c2-4a98-8a48-722c9c6234c2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.165596 Feb 15 04:32:57.849014 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 502/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:57 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:32:58.865275 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:32:58.865860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:32:58.872234 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:58.872689 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:58.873492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:32:58.873933 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:32:59.008577 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:32:59.015866 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5edd92aa-fe99-4fec-b2bf-e8d91fd17554 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.154593 Feb 15 04:32:59.016432 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 533/1035] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:32:58 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:00.032302 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:00.032879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:00.039350 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:00.039801 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:00.040581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:00.041058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:00.181681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:00.188977 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e2c20fac-fa25-47a4-a8b1-b70413d60493 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.160373 Feb 15 04:33:00.189546 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 503/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:00 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:01.205256 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:01.205867 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:01.212707 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:01.213193 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:01.213974 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:01.214409 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:01.349054 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:01.356338 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2042f6d3-9f1b-4fa8-8ba0-9f04fde9edc7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.154735 Feb 15 04:33:01.356919 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 534/1037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:01 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:02.373051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:02.373658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:02.380244 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:02.380692 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:02.381503 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:02.381933 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:02.521559 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:02.529763 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-852632d7-940c-402f-bb90-37153b280717 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.160376 Feb 15 04:33:02.530363 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 504/1038] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:02 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:03.548316 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:03.548860 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:03.555519 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:03.555973 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:03.556752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:03.557218 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:03.701905 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:03.709704 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1056b7a9-c195-431a-a7e5-576e3d445242 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.165139 Feb 15 04:33:03.710269 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 535/1039] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:03 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:04.726563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:04.727171 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:04.733113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:04.733557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:04.734329 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:04.734760 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:04.875165 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:04.883467 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5861ae60-a1b7-4081-9385-b7fad6acdd90 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.161089 Feb 15 04:33:04.884047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 505/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:04 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:04.944203 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-0f4b6e4f-b2fe-4cef-b398-dd24f149b2e5 req-3fa76874-237b-49f2-816a-93099c82be06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "name": "network-vif-plugged", "status": "completed", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:33:04.945904 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:33:04.945904 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:33:04.953316 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-0f4b6e4f-b2fe-4cef-b398-dd24f149b2e5 req-3fa76874-237b-49f2-816a-93099c82be06 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:04.953793 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-0f4b6e4f-b2fe-4cef-b398-dd24f149b2e5 req-3fa76874-237b-49f2-816a-93099c82be06 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:04.965040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-0f4b6e4f-b2fe-4cef-b398-dd24f149b2e5 req-3fa76874-237b-49f2-816a-93099c82be06 service nova] Creating event network-vif-plugged:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:33:04.969989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-0f4b6e4f-b2fe-4cef-b398-dd24f149b2e5 req-3fa76874-237b-49f2-816a-93099c82be06 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030481 Feb 15 04:33:04.970571 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 536/1041] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:33:05.900743 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:05.901362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:05.907615 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:05.908057 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:05.908822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:05.909280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:06.048151 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:06.055750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-03665aa0-e1c1-44ef-9915-141a213a763a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1257 microversion: 2.1 time: 0.158660 Feb 15 04:33:06.056555 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 506/1042] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:05 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:07.073036 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:07.073664 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:07.079879 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:07.080334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:07.081160 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:07.081598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:07.216547 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:07.225066 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d2ef5b03-5a67-4a93-b652-952f07b80b63 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1442 microversion: 2.1 time: 0.156557 Feb 15 04:33:07.225631 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 537/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:07 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:07.240911 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:33:07.241527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:33:07.247811 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:07.248257 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:07.249071 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:07.249511 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:07.383340 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:33:07.390848 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e99f9d32-50c8-4f40-a59e-e6da0b80072b tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1442 microversion: 2.1 time: 0.153923 Feb 15 04:33:07.391415 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 507/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:33:07 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:33:09.392194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-0cdddc3f-d897-48ba-9a08-9e7ed8ea67fe req-5ba0cb42-82a8-436c-a9f2-306a032e5ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:33:09.393717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:33:09.393717 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:33:09.401979 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-0cdddc3f-d897-48ba-9a08-9e7ed8ea67fe req-5ba0cb42-82a8-436c-a9f2-306a032e5ea9 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:33:09.402422 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-0cdddc3f-d897-48ba-9a08-9e7ed8ea67fe req-5ba0cb42-82a8-436c-a9f2-306a032e5ea9 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:33:09.413207 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-0cdddc3f-d897-48ba-9a08-9e7ed8ea67fe req-5ba0cb42-82a8-436c-a9f2-306a032e5ea9 service nova] Creating event network-changed:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:33:09.418944 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-0cdddc3f-d897-48ba-9a08-9e7ed8ea67fe req-5ba0cb42-82a8-436c-a9f2-306a032e5ea9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030359 Feb 15 04:33:09.419543 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 538/1045] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:34:25.351946 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-153811671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-557449170", "security_groups": [{"name": "tempest-secgroup-smoke-1039074646"}], "block_device_mapping_v2": [{"uuid": "49a7392c-5564-4074-942a-5242540ed9d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4287db8-7eb1-4b55-9815-94bfd52e6a07"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:34:25.458075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] validate_networks() for [('a4287db8-7eb1-4b55-9815-94bfd52e6a07', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 04:34:25.823170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 04:34:25.823596 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 04:34:25.824101 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 04:34:25.824514 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 04:34:25.824948 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 04:34:25.833604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:25.834181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:25.834898 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:25.835335 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:25.852474 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 04:34:25.856359 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Getting quotas for user 38c585ad31ef4f50bd695bb379107a9a and project 35abc0d9f3874ffd9bfc3e12d88497c8. Resources: {'ram', 'cores', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 04:34:25.910604 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 04:34:25.912727 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49a7392c-5564-4074-942a-5242540ed9d5',volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 04:34:26.033377 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cd326213-8d54-4605-90a6-0d19f6974c86 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685869 Feb 15 04:34:26.034010 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 508/1046] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Feb 15 04:34:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 04:34:26.045857 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-0a874377-bfaa-4e34-9d72-74bdd4fc5b61 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:26.046559 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-0a874377-bfaa-4e34-9d72-74bdd4fc5b61 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:26.104410 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-0a874377-bfaa-4e34-9d72-74bdd4fc5b61 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:26.112323 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-0a874377-bfaa-4e34-9d72-74bdd4fc5b61 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1093 microversion: 2.1 time: 0.071912 Feb 15 04:34:26.112905 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 539/1047] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:26 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:27.129491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:27.130099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:27.136058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:27.136479 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:27.137346 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:27.137781 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:27.206792 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:27.214591 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a041b8fb-45c4-425f-b5d8-d72e5c538554 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1209 microversion: 2.1 time: 0.090124 Feb 15 04:34:27.215609 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 509/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:27 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:28.231500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:28.232272 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:28.240839 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:28.241320 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:28.243946 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:28.244732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:28.312219 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-adbc135e-5e1d-4d56-a310-321b06fa5861 req-24cdb0a3-7f84-4ab4-a551-bb5feda1b51f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f", "tag": "c1ec4e12-705b-4b78-9551-a7cb48a801c8"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:34:28.314513 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:34:28.314513 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:34:28.325610 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-adbc135e-5e1d-4d56-a310-321b06fa5861 req-24cdb0a3-7f84-4ab4-a551-bb5feda1b51f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:28.328652 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-adbc135e-5e1d-4d56-a310-321b06fa5861 req-24cdb0a3-7f84-4ab4-a551-bb5feda1b51f service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:28.341985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-adbc135e-5e1d-4d56-a310-321b06fa5861 req-24cdb0a3-7f84-4ab4-a551-bb5feda1b51f service nova] Creating event network-changed:c1ec4e12-705b-4b78-9551-a7cb48a801c8 for instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f on hv-cinder-81610 Feb 15 04:34:28.350810 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-adbc135e-5e1d-4d56-a310-321b06fa5861 req-24cdb0a3-7f84-4ab4-a551-bb5feda1b51f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042973 Feb 15 04:34:28.351654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 510/1049] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:34:28.403792 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:28.411700 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bdd857c1-86f9-486f-b595-3dae73c94dae tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.183886 Feb 15 04:34:28.420941 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 540/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:28 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:29.430058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:29.430750 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:29.436862 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:29.437349 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:29.438733 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:29.439159 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:29.574264 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:29.582220 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9dd7c31e-642b-43af-903c-ca0679cb78a9 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.156983 Feb 15 04:34:29.582780 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 511/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:29 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:30.599114 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:30.599725 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:30.606090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:30.606538 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:30.607316 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:30.607752 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:30.741483 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:30.749109 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d8913714-68dc-4f8a-8dd9-44eeefbe8049 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.153764 Feb 15 04:34:30.749685 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 541/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:30 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:31.766744 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:31.767418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:31.774075 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:31.774527 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:31.775314 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:31.775748 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:31.915698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:31.923563 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6dea9f67-fb0a-4b0a-953a-fc9600016d0e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.160549 Feb 15 04:34:31.924121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 512/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:31 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:32.940310 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:32.940955 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:32.947464 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:32.947909 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:32.948679 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:32.949148 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:33.085610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:33.092820 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-486b17e8-e4de-416e-8649-94297e8a9de3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.157167 Feb 15 04:34:33.093500 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 542/1054] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:32 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:34.110047 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:34.110680 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:34.116795 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:34.117280 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:34.118048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:34.118481 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:34.251720 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:34.259741 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-941798ba-7de6-49d2-ac0f-fdbc37ede8a3 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.153870 Feb 15 04:34:34.260233 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 513/1055] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:34 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:35.276510 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:35.277112 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:35.283833 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:35.284276 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:35.285079 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:35.285512 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:35.420005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:35.427519 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-1e7299e9-002d-4aca-8d15-fb24db63cd6c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.154841 Feb 15 04:34:35.428074 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 543/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:35 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:36.443872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:36.444492 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:36.450828 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:36.451286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:36.452074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:36.452510 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:36.592653 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:36.600698 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-60f5c08c-dcb3-48fd-8bd6-014539723f75 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.160433 Feb 15 04:34:36.601412 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 514/1057] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:36 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:37.618023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:37.618597 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:37.624711 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:37.625194 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:37.626607 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:37.627038 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:37.770957 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:37.778271 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-c8673c66-2969-47c5-a4fc-c37ec0308f92 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.163980 Feb 15 04:34:37.778837 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 544/1058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:37 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:38.794623 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:38.795164 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:38.801552 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:38.802001 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:38.802773 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:38.803203 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:39.018681 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:39.025987 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-68970617-9949-4493-a674-c1c6629c6551 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.235148 Feb 15 04:34:39.026548 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 515/1059] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:38 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:39.460869 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-e213297e-f309-4132-8dc5-feb263dabbcc req-4bc59c40-ce65-473f-b588-976e94625758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f", "name": "network-vif-plugged", "status": "completed", "tag": "c1ec4e12-705b-4b78-9551-a7cb48a801c8"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:34:39.463172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:34:39.463172 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:34:39.474198 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-e213297e-f309-4132-8dc5-feb263dabbcc req-4bc59c40-ce65-473f-b588-976e94625758 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:39.474670 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-e213297e-f309-4132-8dc5-feb263dabbcc req-4bc59c40-ce65-473f-b588-976e94625758 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:39.487368 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-e213297e-f309-4132-8dc5-feb263dabbcc req-4bc59c40-ce65-473f-b588-976e94625758 service nova] Creating event network-vif-plugged:c1ec4e12-705b-4b78-9551-a7cb48a801c8 for instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f on hv-cinder-81610 Feb 15 04:34:39.492542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-e213297e-f309-4132-8dc5-feb263dabbcc req-4bc59c40-ce65-473f-b588-976e94625758 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035736 Feb 15 04:34:39.493159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 545/1060] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:34:40.042405 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:40.043016 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:40.049432 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:40.049888 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:40.050674 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:40.051111 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:40.191121 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:40.198493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ca9e2abe-da17-41f2-8cd8-1ae06f1ad910 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1265 microversion: 2.1 time: 0.159757 Feb 15 04:34:40.199055 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 516/1061] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:40 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:41.215801 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:41.216495 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:41.223736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:41.224188 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:41.225107 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:41.225639 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:41.362583 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:41.369891 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-b1f8454a-8a2b-4c99-afba-d16106755feb tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1452 microversion: 2.1 time: 0.158110 Feb 15 04:34:41.370456 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 546/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:41 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:41.385543 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:34:41.386145 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:34:41.392770 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:41.393245 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:41.394011 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:41.394438 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:41.526130 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:34:41.534188 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea224c2b-80c2-4b52-999a-98b50456a7b0 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1452 microversion: 2.1 time: 0.152238 Feb 15 04:34:41.534761 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 517/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:34:41 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:34:42.913315 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:34:42.913958 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:34:43.559586 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-9ef98dc1-37ef-42ef-839f-71c49ac6dbbd req-3d2d8830-60aa-46da-b122-1996c2904269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f", "tag": "c1ec4e12-705b-4b78-9551-a7cb48a801c8"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:34:43.561104 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:34:43.561104 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:34:43.569561 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-9ef98dc1-37ef-42ef-839f-71c49ac6dbbd req-3d2d8830-60aa-46da-b122-1996c2904269 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:34:43.570006 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-9ef98dc1-37ef-42ef-839f-71c49ac6dbbd req-3d2d8830-60aa-46da-b122-1996c2904269 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:34:43.582099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-9ef98dc1-37ef-42ef-839f-71c49ac6dbbd req-3d2d8830-60aa-46da-b122-1996c2904269 service nova] Creating event network-changed:c1ec4e12-705b-4b78-9551-a7cb48a801c8 for instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f on hv-cinder-81610 Feb 15 04:34:43.587140 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-9ef98dc1-37ef-42ef-839f-71c49ac6dbbd req-3d2d8830-60aa-46da-b122-1996c2904269 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031292 Feb 15 04:34:43.587900 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 547/1064] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:34:58.225156 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:34:58.225719 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:35:03.187513 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:35:03.188420 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:35:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:35:23.181581 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:35:23.182196 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:23.187928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:23.188370 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:23.189162 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:23.189751 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:23.212102 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lazy-loading 'flavor' on Instance uuid 5a436a99-1434-4919-8640-e11c3753348c {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:35:23.280739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d6040fd2-e843-4d61-83fb-691db4bbce7c tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "POST /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c/action" status: 202 len: 0 microversion: 2.1 time: 0.102896 Feb 15 04:35:23.281745 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 518/1065] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:35:23 2022] POST /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:35:23.291913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:23.292504 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:23.298513 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:23.300159 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:23.300376 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:23.300813 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:23.482579 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:23.491762 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d43e72c4-ce4b-4db4-924e-a29b4eadd1eb tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.204388 Feb 15 04:35:23.492332 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 548/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:23 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:24.509669 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:24.510368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:24.516598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:24.517077 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:24.517950 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:24.518589 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:24.652424 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:24.660286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2e10c2db-8325-4b6c-9f9d-a2c5ec628c39 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.155184 Feb 15 04:35:24.660856 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 519/1067] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:24 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:25.677581 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:25.678187 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:25.684384 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:25.684836 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:25.685630 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:25.686061 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:25.823305 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:25.830744 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-deb06fa1-183a-461c-89d9-9509d74100c0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.157529 Feb 15 04:35:25.831315 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 549/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:25 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:26.847569 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:26.848175 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:26.854418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:26.854856 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:26.855622 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:26.856051 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:26.993795 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:27.000970 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8c246edc-2ae0-4ce1-8161-35b7bfc393ac tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.157229 Feb 15 04:35:27.001536 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 520/1069] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:26 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:28.018960 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:28.019482 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:28.025755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:28.026204 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:28.026982 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:28.027420 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:28.160017 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:28.167618 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-e8ea9591-cf83-4315-8d94-0ffe90d0e879 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.152934 Feb 15 04:35:28.168171 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 550/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:28 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:29.184649 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:29.185290 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:29.192213 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:29.192662 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:29.193496 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:29.193929 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:29.326249 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:29.334058 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8eb42fff-ed91-48bc-8f33-d0d90a115970 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.153138 Feb 15 04:35:29.334615 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 521/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:29 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:30.350918 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:30.351460 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:30.357981 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:30.358424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:30.359189 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:30.359617 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:30.496646 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:30.503913 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-08de9081-18af-42bd-8f78-4540e7de7cdc tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.156806 Feb 15 04:35:30.504472 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 551/1072] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:30 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:31.519950 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:31.520587 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:31.526879 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:31.527324 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:31.528102 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:31.528536 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:31.661822 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:31.669188 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1513ef82-0af9-4aef-9151-ba60b733eed8 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.153018 Feb 15 04:35:31.669756 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 522/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:31 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:32.685151 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:32.685751 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:32.692144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:32.692586 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:32.693386 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:32.693817 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:32.829658 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:32.836917 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-aa7d6d4f-cf7c-4e5a-ac68-10eaad80c57a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.155426 Feb 15 04:35:32.837492 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 552/1074] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:32 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:33.854451 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:33.855056 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:33.861934 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:33.862387 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:33.863181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:33.863621 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:34.044724 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:34.052557 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-72b1b24c-65ab-4d74-bccf-e031687a5f13 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.201814 Feb 15 04:35:34.053146 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 523/1075] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:33 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:35.069545 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:35.070090 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:35.075881 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:35.076324 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:35.077197 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:35.077629 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:35.212484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:35.224118 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-4667d3cd-08fb-4a64-ae05-14ccfa21e9ab tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1566 microversion: 2.1 time: 0.158980 Feb 15 04:35:35.224691 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 553/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:35 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:36.241867 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:36.242408 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:36.248654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:36.249145 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:36.249920 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:36.250357 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:36.386941 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:36.394920 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b385160c-2ce6-4c8a-8c26-6454e18be476 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1567 microversion: 2.1 time: 0.156718 Feb 15 04:35:36.395507 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 524/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:36 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:36.414111 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:35:36.414111 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:36.419950 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:36.420396 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:36.421215 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:36.421652 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:36.496265 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-2036c150-4491-48c7-9d8f-f8627354eea0 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "POST /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c/action" status: 202 len: 0 microversion: 2.1 time: 0.088200 Feb 15 04:35:36.496802 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 554/1078] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:35:36 2022] POST /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:35:36.504832 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:36.505465 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:36.511353 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:36.511558 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:36.512394 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:36.512868 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:36.652992 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:36.661236 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8f5d8977-484a-4da0-be21-e9c37b9dac99 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1515 microversion: 2.1 time: 0.160126 Feb 15 04:35:36.661899 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 525/1079] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:36 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:35:37.679332 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:37.679930 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:37.685753 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:37.686219 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:37.686994 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:37.687435 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:37.819892 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:37.827099 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5d5b2198-f0d6-4349-8422-c7b60fcf7a72 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.151963 Feb 15 04:35:37.827666 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 555/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:37 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:38.843803 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:38.844368 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:38.850767 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:38.851208 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:38.851979 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:38.852403 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:38.984324 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:38.992443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-07b71afd-33ba-4005-b3b7-53e78ce7b62a tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.152785 Feb 15 04:35:38.993034 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 526/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:38 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:39.788598 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-019b7b89-1619-4e62-a995-e94caba9514d req-26fb7e8e-bb0f-45f5-9f33-4c7e18083217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "name": "network-vif-unplugged", "status": "completed", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:35:39.790245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:35:39.790245 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:35:39.797937 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-019b7b89-1619-4e62-a995-e94caba9514d req-26fb7e8e-bb0f-45f5-9f33-4c7e18083217 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:39.798389 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-019b7b89-1619-4e62-a995-e94caba9514d req-26fb7e8e-bb0f-45f5-9f33-4c7e18083217 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:39.809423 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-019b7b89-1619-4e62-a995-e94caba9514d req-26fb7e8e-bb0f-45f5-9f33-4c7e18083217 service nova] Creating event network-vif-unplugged:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:35:39.814546 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-019b7b89-1619-4e62-a995-e94caba9514d req-26fb7e8e-bb0f-45f5-9f33-4c7e18083217 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030227 Feb 15 04:35:39.815139 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 556/1082] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:35:40.009134 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:40.009744 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:40.015975 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:40.016427 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:40.017239 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:40.017675 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:40.150139 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:40.157356 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-97a91c41-633f-4323-b51b-fb5ba8a4ad68 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.151878 Feb 15 04:35:40.157951 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 527/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:40 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:41.176244 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:41.176956 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:41.183016 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:41.183462 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:41.184229 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:41.184663 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:41.320608 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:41.327880 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-df2ff83c-9cef-4ab5-aba1-3bb3886c5ab6 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.156808 Feb 15 04:35:41.328474 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 557/1084] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:41 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:42.344777 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:42.345337 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:42.351585 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:42.352030 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:42.352798 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:42.353256 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:42.488646 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:42.495844 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3692a423-b51a-460d-bcc5-161ee59298e7 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.154818 Feb 15 04:35:42.496403 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 528/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:42 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:43.512594 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:43.513243 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:43.519989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:43.520444 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:43.521255 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:43.521827 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:43.652642 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:43.660465 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d5923b60-2a2d-4721-be48-11d912959a79 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.151289 Feb 15 04:35:43.661097 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 558/1086] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:43 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:44.677866 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:44.678478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:44.684798 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:44.685286 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:44.686062 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:44.686500 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:44.821729 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:44.828887 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea8b3d7c-2e59-4c97-8e7d-74427584bf06 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.154756 Feb 15 04:35:44.829466 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 529/1087] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:44 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:45.846602 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:45.847424 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:45.853655 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:45.854113 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:45.854900 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:45.855337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:45.997021 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:46.005092 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-3a44a58a-2b84-4df5-ac0d-5803937dc371 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.162267 Feb 15 04:35:46.005650 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 559/1088] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:45 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:47.021593 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:47.022135 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:47.028346 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:47.028794 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:47.029598 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:47.030032 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:47.164493 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:47.171824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-405c2ba1-602c-4af5-925b-0d5bd8a75ec2 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1573 microversion: 2.1 time: 0.153973 Feb 15 04:35:47.172384 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 530/1089] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:47 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:35:47.866567 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [req-fd2016a3-e012-4218-8e02-eb377251a2c4 req-0b4f5f71-7c5a-4e93-96ff-ddf806a1f7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "name": "network-vif-plugged", "status": "completed", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:35:47.868106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:35:47.868106 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: warnings.warn(msg) Feb 15 04:35:47.875479 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-fd2016a3-e012-4218-8e02-eb377251a2c4 req-0b4f5f71-7c5a-4e93-96ff-ddf806a1f7de service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:47.875782 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [req-fd2016a3-e012-4218-8e02-eb377251a2c4 req-0b4f5f71-7c5a-4e93-96ff-ddf806a1f7de service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:47.887491 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.compute.server_external_events [req-fd2016a3-e012-4218-8e02-eb377251a2c4 req-0b4f5f71-7c5a-4e93-96ff-ddf806a1f7de service nova] Creating event network-vif-plugged:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:35:47.892352 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [req-fd2016a3-e012-4218-8e02-eb377251a2c4 req-0b4f5f71-7c5a-4e93-96ff-ddf806a1f7de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029565 Feb 15 04:35:47.892970 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 560/1090] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:35:48.189176 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:35:48.189850 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:35:48.196747 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:48.197235 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:48.198010 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:35:48.198442 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:35:48.327872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:35:48.335099 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-abf225b1-1f02-4840-b9dd-f8eb16bad524 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1560 microversion: 2.1 time: 0.149596 Feb 15 04:35:48.335658 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 531/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:35:48 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:33.549436 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:33.549997 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:33.558107 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:33.558556 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:33.559334 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:33.559764 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:33.587613 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:36:33.610683 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-a2149c43-42c8-43a5-8a79-f8baa2948a00 req-a7bc2b2f-095e-459d-92d4-7d41a7021a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f", "tag": "c1ec4e12-705b-4b78-9551-a7cb48a801c8"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:36:33.613055 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:36:33.613055 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:36:33.620656 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a2149c43-42c8-43a5-8a79-f8baa2948a00 req-a7bc2b2f-095e-459d-92d4-7d41a7021a83 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:33.621146 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a2149c43-42c8-43a5-8a79-f8baa2948a00 req-a7bc2b2f-095e-459d-92d4-7d41a7021a83 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:33.635478 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-a2149c43-42c8-43a5-8a79-f8baa2948a00 req-a7bc2b2f-095e-459d-92d4-7d41a7021a83 service nova] Creating event network-changed:c1ec4e12-705b-4b78-9551-a7cb48a801c8 for instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f on hv-cinder-81610 Feb 15 04:36:33.641005 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-a2149c43-42c8-43a5-8a79-f8baa2948a00 req-a7bc2b2f-095e-459d-92d4-7d41a7021a83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093221 Feb 15 04:36:33.641915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 532/1092] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 04:36:33.680653 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-5e03e2e3-a706-456f-94ef-21a9d9fc47ed tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 204 len: 0 microversion: 2.1 time: 0.135156 Feb 15 04:36:33.684516 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 561/1093] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:36:33 2022] DELETE /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:36:33.694673 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:33.696139 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:33.702844 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:33.703296 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:33.704109 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:33.704547 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:33.989736 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:36:33.997870 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a5615a51-8fab-4163-b7c9-65c2805c21d5 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1576 microversion: 2.1 time: 0.311037 Feb 15 04:36:33.998357 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 533/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:33 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1576 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:35.015842 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:35.016540 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:35.022907 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:35.023306 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:35.024082 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:35.024517 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:35.157564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:36:35.164819 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d74c5035-6bfc-4856-a018-1347c4202020 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1458 microversion: 2.1 time: 0.153005 Feb 15 04:36:35.165421 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 562/1095] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:35 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:35.977301 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-4303c283-db49-407c-853d-cfd5484f4c63 req-a4dd4588-e6b1-41e4-b19c-7c7d09450e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f", "name": "network-vif-deleted", "tag": "c1ec4e12-705b-4b78-9551-a7cb48a801c8"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:36:35.978806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:36:35.978806 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:36:35.986556 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-4303c283-db49-407c-853d-cfd5484f4c63 req-a4dd4588-e6b1-41e4-b19c-7c7d09450e32 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:35.987001 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-4303c283-db49-407c-853d-cfd5484f4c63 req-a4dd4588-e6b1-41e4-b19c-7c7d09450e32 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:35.997985 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-4303c283-db49-407c-853d-cfd5484f4c63 req-a4dd4588-e6b1-41e4-b19c-7c7d09450e32 service nova] Creating event network-vif-deleted:c1ec4e12-705b-4b78-9551-a7cb48a801c8 for instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f on hv-cinder-81610 Feb 15 04:36:36.002859 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-4303c283-db49-407c-853d-cfd5484f4c63 req-a4dd4588-e6b1-41e4-b19c-7c7d09450e32 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029283 Feb 15 04:36:36.003440 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 534/1096] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:36:36.181662 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:36.182288 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:36.188638 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:36.189140 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:36.189938 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:36.190357 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:36.252755 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:36:36.261705 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-41c4da4f-cf13-483f-bb45-978f2863896e tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 200 len: 1224 microversion: 2.1 time: 0.083682 Feb 15 04:36:36.262278 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 563/1097] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:36 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:37.279154 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:37.279847 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:37.285983 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:37.286423 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:37.287928 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:37.288362 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:37.301001 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] HTTP exception thrown: Instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f could not be found. Feb 15 04:36:37.301578 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Returning 404 to user: Instance 4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:36:37.302420 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bcf22d0a-77a3-442b-9082-b1dbe052f1c6 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f" status: 404 len: 111 microversion: 2.1 time: 0.027668 Feb 15 04:36:37.303012 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 535/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:37 2022] GET /compute/v2.1/servers/4fcdf83c-b9c6-49d6-b1d4-d7caeda4f74f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:36:40.353072 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:40.353588 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:40.356153 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-dc4a861d-39da-4a09-be63-b98def0a27bf req-cd3725a1-d714-4043-aaa0-55f86f82d1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884ded66-8e3c-413d-b360-0f2024256a72", "tag": "ad381897-0664-4940-8ca2-2fcfdaa2250f"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:36:40.358278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:36:40.358278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:36:40.360269 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:40.360718 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:40.361720 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:40.362341 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:40.367324 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-dc4a861d-39da-4a09-be63-b98def0a27bf req-cd3725a1-d714-4043-aaa0-55f86f82d1b4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:40.367915 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-dc4a861d-39da-4a09-be63-b98def0a27bf req-cd3725a1-d714-4043-aaa0-55f86f82d1b4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:40.379122 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-dc4a861d-39da-4a09-be63-b98def0a27bf req-cd3725a1-d714-4043-aaa0-55f86f82d1b4 service nova] Creating event network-changed:ad381897-0664-4940-8ca2-2fcfdaa2250f for instance 884ded66-8e3c-413d-b360-0f2024256a72 on hv-cinder-81610 Feb 15 04:36:40.384874 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-dc4a861d-39da-4a09-be63-b98def0a27bf req-cd3725a1-d714-4043-aaa0-55f86f82d1b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032555 Feb 15 04:36:40.385627 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 536/1099] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:36:40.393635 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:36:40.482766 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-6b4f5e40-8205-46f9-919f-788128a07c2c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "DELETE /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 204 len: 0 microversion: 2.1 time: 0.133081 Feb 15 04:36:40.486690 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 564/1100] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:36:40 2022] DELETE /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:36:40.493549 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:40.494820 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:40.501165 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:40.501935 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:40.502968 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:40.503633 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:40.734052 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:36:40.742398 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1326c3f2-7373-4b7b-97a1-3766eb98c234 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1578 microversion: 2.1 time: 0.253602 Feb 15 04:36:40.743335 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 537/1101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:40 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:41.760592 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:41.761359 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:41.767807 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:41.768391 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:41.769218 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:41.769656 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:41.912767 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:36:41.920098 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-bb81bc6c-941b-4421-b38c-7d088bb78e1c tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1460 microversion: 2.1 time: 0.164310 Feb 15 04:36:41.920657 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 565/1102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:41 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1460 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:42.603098 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-4bac965e-4241-444f-962e-72c5466be410 req-967433c8-9af0-40ef-8956-baf633d2d4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884ded66-8e3c-413d-b360-0f2024256a72", "name": "network-vif-deleted", "tag": "ad381897-0664-4940-8ca2-2fcfdaa2250f"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:36:42.604826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:36:42.604826 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:36:42.612690 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-4bac965e-4241-444f-962e-72c5466be410 req-967433c8-9af0-40ef-8956-baf633d2d4f0 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:42.613170 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-4bac965e-4241-444f-962e-72c5466be410 req-967433c8-9af0-40ef-8956-baf633d2d4f0 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:42.625022 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-4bac965e-4241-444f-962e-72c5466be410 req-967433c8-9af0-40ef-8956-baf633d2d4f0 service nova] Creating event network-vif-deleted:ad381897-0664-4940-8ca2-2fcfdaa2250f for instance 884ded66-8e3c-413d-b360-0f2024256a72 on hv-cinder-81610 Feb 15 04:36:42.629784 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-4bac965e-4241-444f-962e-72c5466be410 req-967433c8-9af0-40ef-8956-baf633d2d4f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030259 Feb 15 04:36:42.633484 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 538/1103] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:36:42.936812 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:42.937564 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:42.945136 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:42.945501 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:42.946300 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:42.946732 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:42.979342 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:42.979788 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:42.980242 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.objects.instance [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lazy-loading 'fault' on Instance uuid 884ded66-8e3c-413d-b360-0f2024256a72 {{(pid=116305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 04:36:43.021144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c585ad31ef4f50bd695bb379107a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35abc0d9f3874ffd9bfc3e12d88497c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:36:43.028876 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-a0897ec7-bd88-4be4-b16f-2f58ec377c18 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 200 len: 1230 microversion: 2.1 time: 0.095865 Feb 15 04:36:43.029463 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 566/1104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:42 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:36:44.047113 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:44.047738 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: 884ded66-8e3c-413d-b360-0f2024256a72] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:44.054413 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:44.054865 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:44.055640 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:44.056080 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:44.068990 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] HTTP exception thrown: Instance 884ded66-8e3c-413d-b360-0f2024256a72 could not be found. Feb 15 04:36:44.070104 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Returning 404 to user: Instance 884ded66-8e3c-413d-b360-0f2024256a72 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:36:44.070916 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-25a116e3-023d-4b6e-a77d-4b5b0640f409 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72" status: 404 len: 111 microversion: 2.1 time: 0.028408 Feb 15 04:36:44.071443 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 539/1105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:44 2022] GET /compute/v2.1/servers/884ded66-8e3c-413d-b360-0f2024256a72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:36:44.512009 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:44.512542 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:44.518903 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:44.519362 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:44.520144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:44.520655 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:44.533834 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.wsgi [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] HTTP exception thrown: Instance d1c35f39-3caa-49f1-9289-7514ba7f3edb could not be found. Feb 15 04:36:44.534413 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Returning 404 to user: Instance d1c35f39-3caa-49f1-9289-7514ba7f3edb could not be found. {{(pid=116305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:36:44.535224 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-50a14072-50d3-4966-8819-ba2d8d8d84a8 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 404 len: 111 microversion: 2.1 time: 0.027008 Feb 15 04:36:44.536052 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 567/1106] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:36:44 2022] DELETE /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 04:36:44.544645 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:44.545289 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] [instance: d1c35f39-3caa-49f1-9289-7514ba7f3edb] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:36:44.551039 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:44.551491 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:44.552262 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:36:44.552693 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:36:44.567567 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] HTTP exception thrown: Instance d1c35f39-3caa-49f1-9289-7514ba7f3edb could not be found. Feb 15 04:36:44.568144 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Returning 404 to user: Instance d1c35f39-3caa-49f1-9289-7514ba7f3edb could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:36:44.568989 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-edba3e9c-11aa-401e-b65a-8923f70b6829 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb" status: 404 len: 111 microversion: 2.1 time: 0.028025 Feb 15 04:36:44.569907 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 540/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:36:44 2022] GET /compute/v2.1/servers/d1c35f39-3caa-49f1-9289-7514ba7f3edb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:36:45.846480 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f51304b5-5232-49b5-b4b7-143679ee9024 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] Calling method '.version_select at 0x7fc5d68af3a0>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:36:45.871477 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f51304b5-5232-49b5-b4b7-143679ee9024 tempest-TestVolumeBootPattern-1051022136 tempest-TestVolumeBootPattern-1051022136-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-557449170" status: 202 len: 0 microversion: 2.1 time: 0.029052 Feb 15 04:36:45.872326 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 568/1108] 10.222.0.45 () {58 vars in 1259 bytes} [Tue Feb 15 04:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-557449170 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:38:02.923050 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:38:02.923763 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:38:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:38:18.234093 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:38:18.234621 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:39:20.973013 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:39:20.973937 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:39:20.979824 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:20.980278 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:20.981090 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:20.981530 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:21.006755 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [3c1059c2-74fd-4f7a-b275-58697128d484] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 04:39:22.013441 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [3c1059c2-74fd-4f7a-b275-58697128d484] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 49724. Feb 15 04:39:22.063757 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c6a263e3-dcc8-40f2-be74-0d5c53471135 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "POST /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c/action" status: 200 len: 64385 microversion: 2.1 time: 1.251531 Feb 15 04:39:22.064380 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 541/1109] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Feb 15 04:39:20 2022] POST /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c/action => generated 64385 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 04:39:22.937767 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58ad948d-0db6-4a5a-a309-ae0eed6473b9] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 15 04:39:22.941921 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:39:22.942637 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:39:22.952005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:22.952464 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:22.953299 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:22.953742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:22.979144 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Going to try to terminate instance {{(pid=116305) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 04:39:22.997777 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-c7fa7a2b-1137-41fe-b71e-20dc41430e1a req-14c1347b-667a-49f1-931c-8c36c3ce2bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:39:22.999349 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:39:22.999349 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:39:23.008019 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-c7fa7a2b-1137-41fe-b71e-20dc41430e1a req-14c1347b-667a-49f1-931c-8c36c3ce2bb4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:23.008462 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-c7fa7a2b-1137-41fe-b71e-20dc41430e1a req-14c1347b-667a-49f1-931c-8c36c3ce2bb4 service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:23.020048 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-c7fa7a2b-1137-41fe-b71e-20dc41430e1a req-14c1347b-667a-49f1-931c-8c36c3ce2bb4 service nova] Creating event network-changed:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:39:23.026385 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-c7fa7a2b-1137-41fe-b71e-20dc41430e1a req-14c1347b-667a-49f1-931c-8c36c3ce2bb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088966 Feb 15 04:39:23.027181 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 542/1110] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:39:23.048003 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [83ac73a5-32b0-4345-87f2-ce8851ad01d0] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 04:39:23.946402 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] [58ad948d-0db6-4a5a-a309-ae0eed6473b9] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 49738. Feb 15 04:39:24.055363 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [83ac73a5-32b0-4345-87f2-ce8851ad01d0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 49740. Feb 15 04:39:24.075056 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f7b86223-0c53-4c05-9876-c59be96e0b80 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 204 len: 0 microversion: 2.1 time: 1.140174 Feb 15 04:39:24.075736 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 569/1111] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Feb 15 04:39:22 2022] DELETE /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 0 bytes in 1141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 04:39:24.086699 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:39:24.087406 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:39:24.093894 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:24.094353 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:24.095140 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:24.095577 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:24.244782 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:39:24.251936 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c02ef2e8-2e05-4c97-9db8-6883ea63a796 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1448 microversion: 2.1 time: 0.171122 Feb 15 04:39:24.252489 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 543/1112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:39:24 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:39:25.270303 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:39:25.271001 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:39:25.278040 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:25.278484 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:25.279261 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:25.279696 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:25.415233 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:39:25.422603 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-d8779c0c-7007-47d5-b85d-1b7fce71c427 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1448 microversion: 2.1 time: 0.156320 Feb 15 04:39:25.423181 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 570/1113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:39:25 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 04:39:26.262997 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-be7968db-a45b-45fe-acc6-5606613fe6e0 req-668d9159-e47d-44a1-aa9f-c4d19fe97b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a436a99-1434-4919-8640-e11c3753348c", "name": "network-vif-deleted", "tag": "a8aa04c0-c688-44e4-8d3f-c7b29b85a969"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 04:39:26.265326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:39:26.265326 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Feb 15 04:39:26.274308 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-be7968db-a45b-45fe-acc6-5606613fe6e0 req-668d9159-e47d-44a1-aa9f-c4d19fe97b2d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:26.274799 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-be7968db-a45b-45fe-acc6-5606613fe6e0 req-668d9159-e47d-44a1-aa9f-c4d19fe97b2d service nova] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:26.286321 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-be7968db-a45b-45fe-acc6-5606613fe6e0 req-668d9159-e47d-44a1-aa9f-c4d19fe97b2d service nova] Creating event network-vif-deleted:a8aa04c0-c688-44e4-8d3f-c7b29b85a969 for instance 5a436a99-1434-4919-8640-e11c3753348c on hv-cinder-81610 Feb 15 04:39:26.292654 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-be7968db-a45b-45fe-acc6-5606613fe6e0 req-668d9159-e47d-44a1-aa9f-c4d19fe97b2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 Feb 15 04:39:26.293282 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 544/1114] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Feb 15 04:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 04:39:26.439382 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:39:26.439989 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.compute.api [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116305) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:39:26.446365 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:26.446811 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:26.447577 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:26.448005 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG oslo_concurrency.lockutils [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:26.508800 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.policy [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e57f179296489a9cd4c8d2b028a152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd151428e70f24ac99f8799103edf54fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116305) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 04:39:26.516116 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-f3e98386-6efd-418d-a087-ef0c957ade38 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 200 len: 1217 microversion: 2.1 time: 0.080335 Feb 15 04:39:26.516683 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 571/1115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:39:26 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 04:39:27.534739 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:39:27.535431 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [instance: 5a436a99-1434-4919-8640-e11c3753348c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 04:39:27.541870 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:27.542311 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:27.543074 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 04:39:27.543499 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Lock "7fa80e5b-1bff-48a4-98ae-12c4ecb4d9b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 04:39:27.556805 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] HTTP exception thrown: Instance 5a436a99-1434-4919-8640-e11c3753348c could not be found. Feb 15 04:39:27.557407 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Returning 404 to user: Instance 5a436a99-1434-4919-8640-e11c3753348c could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 04:39:27.558209 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-703a39a4-3e2d-4bd0-8475-5d0dcc230ff9 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c" status: 404 len: 111 microversion: 2.1 time: 0.027925 Feb 15 04:39:27.558722 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 545/1116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Feb 15 04:39:27 2022] GET /compute/v2.1/servers/5a436a99-1434-4919-8640-e11c3753348c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 04:39:27.710330 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: DEBUG nova.api.openstack.wsgi [None req-8534876a-6f1c-4a62-b1ed-9d60f757f701 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] Calling method '.version_select at 0x7fc5d5e85670>' {{(pid=116305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 04:39:27.714906 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8534876a-6f1c-4a62-b1ed-9d60f757f701 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [a3ecf91b-0fdf-4343-a2e1-e3d1f6a4a4cf] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 04:39:28.722610 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [None req-8534876a-6f1c-4a62-b1ed-9d60f757f701 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] [a3ecf91b-0fdf-4343-a2e1-e3d1f6a4a4cf] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 49762. Feb 15 04:39:28.743444 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO nova.api.openstack.requestlog [None req-8534876a-6f1c-4a62-b1ed-9d60f757f701 tempest-TestShelveInstance-842050260 tempest-TestShelveInstance-842050260-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-11064184" status: 202 len: 0 microversion: 2.1 time: 1.036887 Feb 15 04:39:28.744023 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: [pid: 116305|app: 0|req: 572/1117] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Feb 15 04:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-11064184 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 04:39:40.419777 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:39:40.420354 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:39:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:41:22.932158 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:41:22.932742 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:41:38.241560 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:41:38.241986 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:43:00.427883 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:43:00.428575 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:44:42.939864 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:44:42.940489 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:44:55.295850 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:44:55.296651 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:44:58.249620 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:44:58.250418 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:45:00.738275 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:45:00.738872 dv-cinder-816104-2-iscsi devstack@n-api.service[116304]: Tue Feb 15 04:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 04:45:03.206337 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 04:45:03.206871 dv-cinder-816104-2-iscsi devstack@n-api.service[116305]: Tue Feb 15 04:45:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!